-- Logs begin at Wed 2022-08-10 07:45:54 UTC, end at Wed 2022-08-10 09:03:51 UTC. -- Aug 10 08:32:55.360331 dv-cinder-781024-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 08:32:55.368891 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 08:32:55 2022] *** Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: nodename: dv-cinder-781024-3-iscsi Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: machine: x86_64 Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: clock source: unix Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: pcre jit disabled Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: detected number of CPU cores: 4 Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: current working directory: / Aug 10 08:32:55.370994 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: detected binary path: /usr/bin/uwsgi-core Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: your processes number limit is 47680 Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: your memory page size is 4096 bytes Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: detected max file descriptor number: 2048 Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: lock engine: pthread robust mutexes Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: thunder lock: enabled Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 08:32:55.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 08:32:55.410762 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: Python main interpreter initialized at 0x55745cfd39c0 Aug 10 08:32:55.410762 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: python threads support enabled Aug 10 08:32:55.410762 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: your server socket listen backlog is limited to 100 connections Aug 10 08:32:55.410762 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: your mercy for graceful operations on workers is 90 seconds Aug 10 08:32:55.411097 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 08:32:55.411189 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: *** Operational MODE: preforking *** Aug 10 08:32:55.411418 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: *** uWSGI is running in multiple interpreter mode *** Aug 10 08:32:55.411418 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: spawned uWSGI master process (pid: 110294) Aug 10 08:32:55.411601 dv-cinder-781024-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 08:32:55.416181 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: spawned uWSGI worker 1 (pid: 110295, cores: 1) Aug 10 08:32:55.416181 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: spawned uWSGI worker 2 (pid: 110296, cores: 1) Aug 10 08:32:55.416181 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 08:32:56.068957 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 08:32:56.090428 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 08:32:57.145837 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:32:57.145837 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: from cryptography.utils import int_from_bytes Aug 10 08:32:57.146428 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:32:57.146428 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: from cryptography.utils import int_from_bytes Aug 10 08:32:57.148808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:32:57.148808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: from cryptography.utils import int_from_bytes Aug 10 08:32:57.149256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:32:57.149256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: from cryptography.utils import int_from_bytes Aug 10 08:32:59.612464 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:32:59.613041 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:32:59.613140 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:32:59.613140 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:32:59.613579 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:32:59.613670 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:32:59.613761 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:32:59.613843 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:32:59.613928 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:32:59.614118 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:32:59.614214 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.614488 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.614589 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.614824 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.614923 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615142 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615237 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615456 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615551 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615765 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.615859 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616072 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616175 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616383 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616476 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616696 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616790 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.616957 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617048 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617267 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617359 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617575 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617725 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-3-iscsi {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.617892 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618028 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-3-iscsi {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618197 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618329 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618516 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618653 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618824 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.618960 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619129 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619266 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619429 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619555 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619744 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.619876 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.620043 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.620235 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.621452 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.621607 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.621729 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.621859 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.621985 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622107 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622235 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622364 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622518 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622660 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.622926 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623057 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623186 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623320 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623443 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623576 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623707 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623839 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.623967 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624103 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624234 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-3-iscsi {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624352 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-3-iscsi {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624495 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624628 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624759 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.624881 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625009 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625131 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625265 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625413 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625538 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625666 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625800 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.625930 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626077 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626203 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626332 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626509 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626655 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626820 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.626954 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627145 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627276 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627461 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627581 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627774 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.627907 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628087 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628213 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628383 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628517 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628686 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628821 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.628990 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629124 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629303 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629441 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629605 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629737 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629861 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.629991 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630122 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630252 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630428 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630602 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630770 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.630906 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631082 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631209 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631341 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631475 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631611 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631746 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631872 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.631999 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632164 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632299 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632469 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632595 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632769 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.632893 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633071 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633214 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633371 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633502 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633673 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633804 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.633972 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634110 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634274 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634405 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634595 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634723 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.634895 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635031 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635206 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635335 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635513 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635646 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635816 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.635954 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636115 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636250 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636427 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636559 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636750 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.636883 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637056 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637188 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637358 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637485 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637691 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637825 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.637996 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638121 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638298 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638430 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638630 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638756 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.638936 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.639069 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.639787 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.639921 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640053 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640184 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640340 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640468 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640655 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640781 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.640986 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641120 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641256 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641385 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641509 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641639 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641763 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.641894 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642066 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642192 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642368 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642529 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642690 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642822 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.642991 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643119 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643288 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643422 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643580 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643706 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.643881 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644008 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644180 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644316 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644481 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644605 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644778 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.644903 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645077 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645215 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645372 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645505 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645672 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645800 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.645969 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646103 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646266 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646394 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646599 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646726 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.646900 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647026 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647200 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647325 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647504 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647634 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647805 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.647947 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648102 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648235 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648411 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648537 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648706 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.648844 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649005 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649131 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649310 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649442 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649604 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649729 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.649901 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650035 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650206 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650332 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650522 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650659 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650824 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.650952 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651120 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651245 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651413 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651539 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651712 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.651840 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652014 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652146 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652311 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652444 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652608 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652740 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.652901 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653039 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653198 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653323 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653492 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653624 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653786 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.653925 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.654061 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.654190 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.654361 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.654527 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.654677 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.655422 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.655555 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.655685 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.655842 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.655970 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656145 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656275 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656443 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656569 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656743 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.656876 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.657055 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:32:59.657183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.657389 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.657524 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.657718 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.657844 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658161 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658353 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658504 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658705 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.658842 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659021 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659147 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659334 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659463 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659640 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659775 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.659953 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660087 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660261 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660396 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660569 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660709 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.660876 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661009 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661184 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661310 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661499 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661638 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.661814 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662018 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662151 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662262 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662429 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662678 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662815 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.662939 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663060 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663182 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663373 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663514 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663685 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.663818 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664007 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664132 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664316 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664456 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664622 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664747 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.664956 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665090 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665282 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665417 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665592 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665718 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.665910 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666043 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666220 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666383 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666553 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666684 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666859 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.666986 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667164 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667299 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667485 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667613 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667796 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.667928 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668100 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668233 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668410 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668538 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668717 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.668844 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669023 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669151 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669328 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669463 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669634 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669773 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.669937 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670064 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670261 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670411 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670615 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670759 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.670926 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671052 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671232 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671356 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671542 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671676 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671847 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.671973 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672151 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672277 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672452 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672586 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672751 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.672885 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673051 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673178 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673347 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673474 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673649 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673774 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.673944 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674070 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674391 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674595 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674724 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.674896 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675033 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675212 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675339 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675511 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675636 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675814 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.675941 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676120 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676247 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676419 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676544 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676718 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.676853 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677023 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677154 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677326 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677453 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677624 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677758 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.677939 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678073 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678241 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678365 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678559 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678700 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.678875 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.679010 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.679174 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.679302 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.679735 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.679871 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680042 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680169 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680344 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680472 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680648 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680784 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.680952 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681080 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681384 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681567 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681693 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681874 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.681999 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682179 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682315 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682528 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682659 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.682972 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683143 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683278 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683459 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683588 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683772 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.683898 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684076 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684211 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684373 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684500 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684675 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684800 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.684973 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685107 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685273 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685407 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685572 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685699 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.685872 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686006 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686191 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686324 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686509 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686639 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686811 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.686949 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687111 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687245 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687413 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687539 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687726 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.687855 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688026 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688160 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688321 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688454 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688617 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688746 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.688913 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689040 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689249 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689374 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689546 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689672 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.689880 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690007 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690207 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690334 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690563 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690700 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690849 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.690983 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691157 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691294 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691465 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691590 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691768 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.691895 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692076 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692212 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692384 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692510 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692688 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692814 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.692997 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693123 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693331 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693457 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693602 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693728 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.693907 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694044 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694215 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694339 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694540 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694667 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694850 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.694987 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695151 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695283 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695464 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695597 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.695924 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696114 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696244 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696423 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696548 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696732 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.696865 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697036 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697168 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697346 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697478 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697648 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697781 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.697953 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698079 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698383 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698583 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698711 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.698890 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699014 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699195 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699327 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699500 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699625 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699801 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.699927 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700116 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700253 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700421 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700556 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700724 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.700849 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.701020 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.701153 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.701329 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.701456 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702160 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702291 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702485 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702626 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702798 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.702923 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703105 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703232 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703413 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703548 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703707 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.703841 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704010 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704137 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704312 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704438 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704610 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704734 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.704910 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705035 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705213 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705351 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705518 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705643 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705819 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.705946 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706119 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706252 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706415 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706593 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706747 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.706875 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707046 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707174 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707475 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707641 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707780 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.707953 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708088 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708258 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708383 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708561 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708696 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.708875 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709010 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709175 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709300 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709474 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709608 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709774 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.709907 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710083 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710216 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710384 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710540 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710703 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.710829 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711002 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711137 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711297 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711423 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711649 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711781 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.711912 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712043 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712218 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712388 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712514 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712645 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712827 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.712951 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713126 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713247 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713429 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713554 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713729 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.713853 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714030 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714159 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714336 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714460 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714662 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714808 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.714964 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715091 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715268 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715395 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715571 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715712 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.715873 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716000 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716177 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716304 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716480 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716619 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716779 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.716911 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717083 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717207 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717433 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717569 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717730 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.717865 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.718040 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.718176 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.718352 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.718619 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.718926 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719065 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719250 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719382 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719594 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719789 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.719912 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720043 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720175 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720306 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720439 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720572 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720766 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.720894 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721224 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721406 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721549 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721703 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.721838 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722004 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722130 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722301 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722426 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722628 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722754 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.722914 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723048 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723214 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723335 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723513 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723641 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723812 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.723940 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724111 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724245 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724406 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724539 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724703 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724835 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.724997 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725132 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725294 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725422 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725591 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725715 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.725886 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726024 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726186 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726312 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726497 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726625 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726821 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.726959 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727123 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727242 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727423 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727557 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727723 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.727859 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728047 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728174 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728355 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728480 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728665 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728782 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.728995 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729122 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729317 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729451 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729618 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729745 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.729920 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730221 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730356 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730548 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730686 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730850 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.730977 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731145 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731278 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731442 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731578 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731743 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.731869 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732042 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732177 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732336 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732475 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732640 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.732769 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.733493 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.733634 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.733759 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.733882 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734155 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734324 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734515 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734642 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734765 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.734936 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735063 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735239 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735372 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735537 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735671 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735832 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.735958 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736127 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736253 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736426 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736550 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736724 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.736857 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737020 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737147 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737315 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737440 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737608 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737733 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.737913 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738040 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738208 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738333 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738530 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738658 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738830 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.738949 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739133 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739267 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739431 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739571 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739725 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.739850 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740041 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740167 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740341 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740478 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740636 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740770 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.740931 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741058 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741229 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741367 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741523 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741654 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741819 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.741945 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742121 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742262 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742435 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742586 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742761 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.742889 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743091 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743224 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743357 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743481 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743630 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743718 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.743927 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744014 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744222 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744308 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744518 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744602 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744812 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.744898 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745107 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745194 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745403 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745497 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745698 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745793 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.745995 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746081 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746308 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746403 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746633 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746720 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.746932 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747018 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747229 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747324 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747526 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747620 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747857 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.747987 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.748153 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.748289 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.748549 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749164 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749351 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749477 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749659 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749799 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.749972 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750105 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750280 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750405 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750597 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750730 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.750902 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751035 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751202 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751326 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751507 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751634 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751810 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.751934 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752109 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752234 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752406 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752531 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752703 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.752829 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753014 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753145 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753318 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753443 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753622 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753750 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.753935 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754060 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754248 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754373 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754571 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754708 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.754870 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755003 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755172 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755305 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755477 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755610 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755778 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.755920 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756082 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756216 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756382 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756514 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756686 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756821 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.756990 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757116 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757295 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757429 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757734 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.757899 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758017 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758200 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758326 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758533 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758660 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758840 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.758979 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759140 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759256 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759457 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759590 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759759 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.759885 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760056 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760188 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760355 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760481 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760652 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760777 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.760955 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761080 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761252 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761379 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761666 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761800 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.761972 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762111 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762275 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762410 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762649 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762784 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.762909 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763039 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763165 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763287 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763479 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763607 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763787 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.763922 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764236 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764639 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764820 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.764955 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765127 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765253 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765429 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765555 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765727 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.765853 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766025 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766152 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766330 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766504 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766644 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766768 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.766945 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767075 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767241 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767367 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767540 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767660 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767844 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.767969 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768140 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768264 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768460 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768587 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768859 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.768983 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769160 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769295 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769457 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769581 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769859 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.769985 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770163 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770298 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770485 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770613 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770808 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.770945 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771120 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771254 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771421 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771546 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771720 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.771861 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772025 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772150 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772325 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772460 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772644 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772773 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.772950 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773075 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773255 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773389 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773556 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773682 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773852 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.773977 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774169 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774305 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774498 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774626 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774795 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.774931 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775110 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775237 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775512 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775639 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775817 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.775950 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776119 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776244 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776431 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776558 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776731 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.776869 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777032 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777166 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777328 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777454 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777627 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777753 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.777923 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778056 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778220 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778348 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778553 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778691 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778852 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.778978 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779155 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779282 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779456 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779589 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779772 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.779900 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780072 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780200 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780369 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780505 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780675 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780802 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.780968 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781094 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781284 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781411 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781589 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781715 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.781902 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782037 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782204 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782330 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782519 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782648 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782828 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.782953 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783129 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783266 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783425 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783550 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783723 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.783841 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784017 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784144 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784347 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784472 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784643 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784777 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.784956 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785083 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785279 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785418 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785585 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785723 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.785891 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786018 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786215 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786350 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786548 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786687 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786857 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.786990 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787165 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787302 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787467 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787600 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787767 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.787884 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788065 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788193 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788371 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788496 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788667 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788801 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.788964 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789104 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789304 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789431 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789545 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789677 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789830 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.789966 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790124 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790251 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790419 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790753 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.790892 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791049 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791174 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791363 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791492 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791662 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791795 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.791959 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792084 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792256 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792380 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792549 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792683 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.792881 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793008 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793178 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793314 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793499 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793634 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793791 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.793910 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794107 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794234 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794420 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794566 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794753 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.794878 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.795064 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.795191 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.795881 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796016 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796193 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796321 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796503 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796631 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796827 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.796952 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797106 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797231 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797419 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797545 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797727 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.797855 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.798037 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.798240 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.798577 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.798709 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.798904 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799032 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799216 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799351 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799527 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799654 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799834 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.799961 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800144 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800277 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800451 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800586 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800759 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.800886 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801064 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801190 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801370 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801511 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801674 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801800 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.801995 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802131 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802311 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802655 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802799 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.802971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803098 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803283 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803417 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803589 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803718 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.803897 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.804025 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.804205 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.804590 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.804808 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.804934 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805113 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805250 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805412 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805537 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805720 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.805854 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806027 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806155 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806332 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806458 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806661 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806789 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.806966 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807098 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807273 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807399 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807576 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807701 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.807880 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808017 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808180 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808314 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808485 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808621 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808796 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.808932 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809111 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809239 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809427 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809566 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809738 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.809865 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810043 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810170 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810351 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810510 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810684 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.810892 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.811736 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.811868 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812049 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812186 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812376 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812539 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812695 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.812823 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813007 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813134 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813313 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813438 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813624 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813751 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.813934 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814061 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814233 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814359 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814555 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814685 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814864 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.814999 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815165 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815298 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815463 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815599 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815777 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.815909 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816078 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816211 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816376 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816516 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816688 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816813 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.816988 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.817215 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.817505 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.817650 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.817841 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.817968 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818149 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818285 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818483 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818629 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818813 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.818939 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819118 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819252 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819419 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819546 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819730 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.819859 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820029 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820155 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820329 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820458 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820637 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820762 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.820941 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821069 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821238 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821371 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821538 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821665 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821845 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.821972 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822145 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822281 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822441 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822582 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822768 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.822906 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823069 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823193 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823385 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823512 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823686 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823825 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.823986 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824112 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824283 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824410 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824583 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824717 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.824880 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825006 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825180 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825316 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825477 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825617 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825773 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.825900 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826074 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826200 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826405 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826571 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826727 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826854 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.826977 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827099 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827287 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827417 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827590 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827716 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.827893 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828020 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828212 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828340 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828515 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828649 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828840 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.828964 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829173 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829299 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829481 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829615 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829784 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.829918 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830094 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830231 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830399 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830554 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830730 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.830866 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.831067 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.831193 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.831377 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.831595 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.831900 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832041 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832229 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832358 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832545 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832672 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.832871 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833008 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833177 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833302 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833480 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833606 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833782 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.833911 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834083 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834212 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834403 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834554 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834734 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.834870 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835041 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835169 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835346 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835481 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835651 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835778 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.835954 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836087 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836260 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836397 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836564 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836693 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836868 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.836996 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837171 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837307 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837474 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837610 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837777 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.837904 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838079 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838219 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838380 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838532 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838711 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.838838 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839018 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839147 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839351 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839478 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839667 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839793 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.839977 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840110 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840287 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840414 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840595 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840720 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.840897 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841023 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841201 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841332 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841504 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841631 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841807 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.841936 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842115 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842270 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842453 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842609 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842781 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.842910 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843079 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843206 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843487 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843628 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843795 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.843934 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844109 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844236 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844417 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844552 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844719 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.844845 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845033 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845160 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845339 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845467 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845643 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845768 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.845955 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846081 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846256 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846390 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846601 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846730 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.846931 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847059 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847252 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847379 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847558 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847685 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847857 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.847991 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848155 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848282 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848452 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848579 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848760 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.848895 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849071 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849197 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849371 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849498 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849669 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849803 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.849962 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850088 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850264 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850403 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850584 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850729 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.850884 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851182 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851310 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851478 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851615 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851775 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.851901 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852068 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852202 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852366 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852506 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852662 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852797 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.852958 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853085 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853255 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853384 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853549 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853675 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853849 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.853975 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854143 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854269 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854439 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854586 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854756 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.854964 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855100 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855224 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855347 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855470 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855647 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855785 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.855970 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856098 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856276 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856410 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856585 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856719 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.856884 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857010 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857195 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857328 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857494 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857628 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.857806 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.858444 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.858663 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.858788 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.858969 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859088 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859279 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859415 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859601 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859735 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.859903 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860210 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860337 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860516 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860649 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860818 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.860943 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861120 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861247 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861424 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861561 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861741 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.861869 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862042 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862167 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862346 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862547 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862682 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862808 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.862988 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863117 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863301 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863439 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863608 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863733 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.863915 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864042 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864227 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864353 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864532 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864840 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.864965 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865143 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865270 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865446 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865581 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865751 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.865878 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866057 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866195 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866359 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866531 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866694 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866842 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.866996 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867121 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867300 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867428 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867620 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867757 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.867929 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868055 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868233 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868360 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868553 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868686 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.868872 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869007 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869190 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869315 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869513 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869651 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869845 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.869977 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870158 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870285 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870509 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870639 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870796 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.870935 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.871060 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:32:59.871184 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:32:59.871316 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:33:00.024067 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO dbcounter [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Registered counter for database nova_api Aug 10 08:33:00.024504 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO dbcounter [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Registered counter for database nova_api Aug 10 08:33:00.045305 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_db.sqlalchemy.engines [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.048712 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_db.sqlalchemy.engines [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.052419 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writer thread running {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.055493 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writer thread running {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.107657 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.context [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9b14cff7-dd7a-4ce6-bf18-ff6ec854a829(cell1) {{(pid=110295) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 08:33:00.110287 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.context [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9b14cff7-dd7a-4ce6-bf18-ff6ec854a829(cell1) {{(pid=110296) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 08:33:00.112067 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:33:00.112542 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:33:00.114168 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:33:00.114279 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:33:00.114665 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:33:00.114873 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:33:00.115319 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:33:00.116238 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:33:00.116955 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:33:00.117305 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:33:00.117419 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:33:00.119301 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO dbcounter [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Registered counter for database nova_cell0 Aug 10 08:33:00.119415 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_concurrency.lockutils [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:33:00.121354 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO dbcounter [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Registered counter for database nova_cell0 Aug 10 08:33:00.124629 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO dbcounter [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Registered counter for database nova_cell1 Aug 10 08:33:00.126831 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO dbcounter [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Registered counter for database nova_cell1 Aug 10 08:33:00.131982 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_db.sqlalchemy.engines [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.133625 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_db.sqlalchemy.engines [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.135721 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_db.sqlalchemy.engines [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.137349 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_db.sqlalchemy.engines [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.137790 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writer thread running {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.142854 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writer thread running {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.145611 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writer thread running {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.274953 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writer thread running {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.284699 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO dbcounter [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Registered counter for database nova_cell0 Aug 10 08:33:00.288325 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO dbcounter [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Registered counter for database nova_cell0 Aug 10 08:33:00.293678 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_db.sqlalchemy.engines [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.297747 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG oslo_db.sqlalchemy.engines [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:33:00.298675 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writer thread running {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.302282 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writer thread running {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:33:00.707605 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: WARNING keystonemiddleware.auth_token [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:33:00.714798 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: WARNING keystonemiddleware.auth_token [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:33:00.738416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: WARNING keystonemiddleware.auth_token [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:33:00.745516 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: WARNING keystonemiddleware.auth_token [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:33:01.055070 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: WARNING keystonemiddleware.auth_token [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:33:01.060959 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: WARNING keystonemiddleware.auth_token [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:33:01.066888 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55745cfd39c0 pid: 110295 (default app) Aug 10 08:33:01.068942 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:33:01.070120 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Aug 10 08:33:01.070527 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Wed Aug 10 08:33:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:33:01.082665 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: WARNING keystonemiddleware.auth_token [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:33:01.088556 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: WARNING keystonemiddleware.auth_token [None req-241e4bde-bc93-49df-bde9-597452d21bad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:33:01.093764 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55745cfd39c0 pid: 110296 (default app) Aug 10 08:34:18.828185 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:18.829183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 10 08:34:18.829570 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:18.841961 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_api:SELECT=3 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:18.843142 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_cell0:SELECT=3 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:18.844148 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_cell1:SELECT=3 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:18.845180 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:19.720542 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-43d276a9-12f0-4c7b-9ed5-669350567a1e admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:19.751977 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-43d276a9-12f0-4c7b-9ed5-669350567a1e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915660 Aug 10 08:34:19.752758 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 08:34:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:34:21.953377 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:21.954599 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-cc587164-7dc5-4e6a-bce0-36ec632532aa None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Aug 10 08:34:21.955079 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:22.398209 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-1964d3cd-000e-4e14-bcbf-77dc877dddc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:22.418376 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:34:22.418376 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: warnings.warn(msg) Aug 10 08:34:22.500519 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-1964d3cd-000e-4e14-bcbf-77dc877dddc9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.539153 Aug 10 08:34:22.501398 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:22.515815 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_api:SELECT=3 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.517335 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_cell0:SELECT=3 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.518304 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_cell1:SELECT=3 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.519039 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:22.729685 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-f7fec062-7e83-4a75-9bb1-38baf24059b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:22.734059 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:34:22.734059 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:34:22.847676 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-f7fec062-7e83-4a75-9bb1-38baf24059b1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337845 Aug 10 08:34:22.848443 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 08:34:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:34:25.079677 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-1964d3cd-000e-4e14-bcbf-77dc877dddc9 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:25.080677 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-1964d3cd-000e-4e14-bcbf-77dc877dddc9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 10 08:34:25.081342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:25.746657 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-a6ae8dc6-8466-482b-be67-63c6b786fa3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "vcpus": 1}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:25.766623 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:34:25.766623 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:34:25.875962 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-a6ae8dc6-8466-482b-be67-63c6b786fa3a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.787487 Aug 10 08:34:25.877466 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:25.891397 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-1bced402-d0b9-4131-9bbe-e2ee824253d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:25.909122 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:34:25.909122 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: warnings.warn(msg) Aug 10 08:34:25.998620 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-1bced402-d0b9-4131-9bbe-e2ee824253d5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111673 Aug 10 08:34:25.999361 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 08:34:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:28.200499 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-a6ae8dc6-8466-482b-be67-63c6b786fa3a admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:28.201518 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-a6ae8dc6-8466-482b-be67-63c6b786fa3a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 10 08:34:28.202119 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:28.616776 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-20e95928-9dd7-4256-9bad-d8022f10d1d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d2"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:28.716088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-20e95928-9dd7-4256-9bad-d8022f10d1d1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507242 Aug 10 08:34:28.716899 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 08:34:28.728976 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-fda7ea93-d3b5-4218-8f56-3f2328705f77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:28.804648 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-fda7ea93-d3b5-4218-8f56-3f2328705f77 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079286 Aug 10 08:34:28.805220 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 08:34:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:30.975721 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-20e95928-9dd7-4256-9bad-d8022f10d1d1 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:30.976751 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-20e95928-9dd7-4256-9bad-d8022f10d1d1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 08:34:30.977150 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:31.435170 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-60e980aa-e4b9-4f73-a596-bb5d17e39bba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:31.529506 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-60e980aa-e4b9-4f73-a596-bb5d17e39bba admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546225 Aug 10 08:34:31.530065 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:31.544379 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-81f2f5e8-ced6-4529-a097-29d9383b74cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:31.643905 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-81f2f5e8-ced6-4529-a097-29d9383b74cf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104428 Aug 10 08:34:31.650494 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 08:34:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:33.825608 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-60e980aa-e4b9-4f73-a596-bb5d17e39bba admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:33.826642 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-60e980aa-e4b9-4f73-a596-bb5d17e39bba admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 10 08:34:33.827033 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:34.241167 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "disk": 20}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:34.332152 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498977 Aug 10 08:34:34.332930 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:34.346452 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-1635f661-e188-4214-b692-23f854b1d1fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:34.458542 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-1635f661-e188-4214-b692-23f854b1d1fc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116253 Aug 10 08:34:34.469890 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1336 bytes} [Wed Aug 10 08:34:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:34:36.664218 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:36.665223 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 10 08:34:36.665623 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:37.070687 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-a0cf3828-4680-4af3-b483-a2bf94547ff7 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:37.095119 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-a0cf3828-4680-4af3-b483-a2bf94547ff7 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.423280 Aug 10 08:34:37.095715 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 08:34:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:34:39.353996 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:39.355034 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-65018de6-2c4e-4575-ac38-834fdc78096a admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 10 08:34:39.355455 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:39.766519 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-fee96e5b-925a-4730-8593-577d27c771e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:39.835551 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-fee96e5b-925a-4730-8593-577d27c771e5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.473507 Aug 10 08:34:39.836089 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:39.848126 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-9a5dd448-086e-4aa6-a1c6-d38fd58ca8ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:39.930836 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-9a5dd448-086e-4aa6-a1c6-d38fd58ca8ff admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086097 Aug 10 08:34:39.931594 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 08:34:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:34:42.073418 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-fee96e5b-925a-4730-8593-577d27c771e5 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:42.075052 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-fee96e5b-925a-4730-8593-577d27c771e5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 08:34:42.075454 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:42.464479 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-55edc7b8-a9d3-46a1-88aa-9ec746ddd2c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:42.546580 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-55edc7b8-a9d3-46a1-88aa-9ec746ddd2c8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.464935 Aug 10 08:34:42.547064 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:42.559514 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-16207db8-6a64-48d6-b74d-27098b200acf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:42.633354 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-16207db8-6a64-48d6-b74d-27098b200acf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077422 Aug 10 08:34:42.634130 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 08:34:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:44.820818 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-55edc7b8-a9d3-46a1-88aa-9ec746ddd2c8 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:44.821834 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-55edc7b8-a9d3-46a1-88aa-9ec746ddd2c8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 10 08:34:44.822236 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:45.194543 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-ce6cd910-e53e-4b7a-910a-16178b8312d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "swap": 0}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:45.270157 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-ce6cd910-e53e-4b7a-910a-16178b8312d5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441357 Aug 10 08:34:45.277979 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 08:34:45.283847 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-44170c38-9315-4d07-9f24-70b373f8e759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:45.364579 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-44170c38-9315-4d07-9f24-70b373f8e759 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085397 Aug 10 08:34:45.365197 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 08:34:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:47.568377 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-ce6cd910-e53e-4b7a-910a-16178b8312d5 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:47.570078 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-ce6cd910-e53e-4b7a-910a-16178b8312d5 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Aug 10 08:34:47.570551 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:48.014858 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-08d0a013-5754-4b46-9f48-7ca4d42a2bda admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:48.110051 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-08d0a013-5754-4b46-9f48-7ca4d42a2bda admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.532738 Aug 10 08:34:48.110630 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 08:34:48.122704 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-9a9d660d-0f75-472c-ae68-a0e3c65f8066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:48.215320 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-9a9d660d-0f75-472c-ae68-a0e3c65f8066 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095760 Aug 10 08:34:48.216190 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 08:34:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:34:50.423029 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-08d0a013-5754-4b46-9f48-7ca4d42a2bda admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:34:50.424072 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-08d0a013-5754-4b46-9f48-7ca4d42a2bda admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 10 08:34:50.424802 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:34:50.865663 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "id": "5"}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:50.949888 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.516940 Aug 10 08:34:50.950443 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1283 bytes} [Wed Aug 10 08:34:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:34:50.963318 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-71d47326-f50f-46d5-9a8a-47ab8648ec09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:34:50.970862 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:34:51.047870 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-71d47326-f50f-46d5-9a8a-47ab8648ec09 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088611 Aug 10 08:34:51.049093 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1333 bytes} [Wed Aug 10 08:34:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:35:11.661844 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:11.662915 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 08:35:11.663324 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:12.048565 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-f3c7a9b8-26db-4d43-9313-c97f0b0acefc admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:12.066653 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-f3c7a9b8-26db-4d43-9313-c97f0b0acefc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396964 Aug 10 08:35:12.067179 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 08:35:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:13.119849 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:13.120862 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-e2ca6825-3b41-4dac-b6d2-e7d07068bb5e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 10 08:35:13.121295 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:13.638354 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-8190e5b9-e58f-41ef-aeb1-6bd5dd076388 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:13.643899 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.wsgi [None req-8190e5b9-e58f-41ef-aeb1-6bd5dd076388 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-8190e5b9-e58f-41ef-aeb1-6bd5dd076388 admin admin] Request method failure captured: Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept: application/json Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept-Encoding: gzip, deflate Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Connection: keep-alive Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Content-Length: 0 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Host: 10.222.0.45 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-System-Scope: None Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: User-Agent: python-novaclient Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Auth-Token: gAAAAABi823Bf2r-j_JchxaFs9reoD9Kg_BxC3K7TmBFCFTpZ3a3ZFaHddTLyjCQerVbO6cAO5aD3cJu8GC6TCfCiYi_zc1onS8fRWQLlYMMJtsVMuN571NaV6zmdUgfKnPyRuDigArUYbJC9Rqsb0ds5Dkgx2xVmZsWIxW6bqH6VrhTRWn-tn4 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Id: None Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Name: None Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Identity-Status: Confirmed Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Is-Admin-Project: True Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Id: default Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Name: Default Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Name: admin Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Role: admin,reader,member Aug 10 08:35:13.647355 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Roles: admin,reader,member Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant: admin Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Name: admin Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User: admin Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Id: default Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Name: Default Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Name: admin Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: method: > Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: exception: Flavor 42 could not be found. Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: action_args: {'id': '42'} Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:13.649054 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:13.650088 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.651635 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-8190e5b9-e58f-41ef-aeb1-6bd5dd076388 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:13.653003 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-8190e5b9-e58f-41ef-aeb1-6bd5dd076388 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390367 Aug 10 08:35:13.653003 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 08:35:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:13.659143 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-764fa37f-339a-46b6-87d1-f96fc77251ce admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:13.663413 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:35:13.682216 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-764fa37f-339a-46b6-87d1-f96fc77251ce admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026661 Aug 10 08:35:13.682790 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:13.692919 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-0c46f566-6ce0-48f9-b2ed-debc39b3fdd8 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:13.716764 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-0c46f566-6ce0-48f9-b2ed-debc39b3fdd8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027362 Aug 10 08:35:13.717490 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:13.726775 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-27554de0-5385-4448-98f5-6ba13ce1f092 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:13.732935 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.wsgi [None req-27554de0-5385-4448-98f5-6ba13ce1f092 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-27554de0-5385-4448-98f5-6ba13ce1f092 admin admin] Request method failure captured: Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept: application/json Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept-Encoding: gzip, deflate Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Connection: keep-alive Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Content-Length: 0 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Host: 10.222.0.45 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-System-Scope: None Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: User-Agent: python-novaclient Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Auth-Token: gAAAAABi823Bf2r-j_JchxaFs9reoD9Kg_BxC3K7TmBFCFTpZ3a3ZFaHddTLyjCQerVbO6cAO5aD3cJu8GC6TCfCiYi_zc1onS8fRWQLlYMMJtsVMuN571NaV6zmdUgfKnPyRuDigArUYbJC9Rqsb0ds5Dkgx2xVmZsWIxW6bqH6VrhTRWn-tn4 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Id: None Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Name: None Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Identity-Status: Confirmed Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Is-Admin-Project: True Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Id: default Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Name: Default Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Name: admin Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Role: admin,reader,member Aug 10 08:35:13.736183 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Roles: admin,reader,member Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant: admin Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Name: admin Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User: admin Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Id: default Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Name: Default Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Name: admin Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: method: > Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: exception: Flavor 42 could not be found. Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: action_args: {'id': '42'} Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:13.737834 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:13.747311 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:13.748479 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-27554de0-5385-4448-98f5-6ba13ce1f092 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:13.749580 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-27554de0-5385-4448-98f5-6ba13ce1f092 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014691 Aug 10 08:35:13.749580 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 08:35:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:14.695329 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-0c46f566-6ce0-48f9-b2ed-debc39b3fdd8 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:14.696352 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-0c46f566-6ce0-48f9-b2ed-debc39b3fdd8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 10 08:35:14.696749 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:15.219628 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-3dcba961-3adf-4c06-b260-b1561b98c0a2 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:15.224953 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.wsgi [None req-3dcba961-3adf-4c06-b260-b1561b98c0a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-3dcba961-3adf-4c06-b260-b1561b98c0a2 admin admin] Request method failure captured: Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept: application/json Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept-Encoding: gzip, deflate Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Connection: keep-alive Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Content-Length: 0 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Host: 10.222.0.45 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-System-Scope: None Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: User-Agent: python-novaclient Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Auth-Token: gAAAAABi823CnM2KpDR2DJZcQ_s62seW4Nju9aKi3eSi0aZAQd7OXNrEb2QIjQDwRxoIqYI9K4GXlJPa8V5jCdfWwo02fSB_Nrdhgi_jXeLdTgcjpZbaz9CPkm6WD13mLrSmn-BLmYca5hXVNdzDFNfKg6Sdae5kQMxQvNPtRihNvPVYVrYYuOw Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Id: None Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Name: None Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Identity-Status: Confirmed Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Is-Admin-Project: True Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Id: default Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Name: Default Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Name: admin Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Role: admin,reader,member Aug 10 08:35:15.226439 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Roles: admin,reader,member Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant: admin Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Name: admin Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User: admin Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Id: default Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Name: Default Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Name: admin Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: method: > Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: exception: Flavor 84 could not be found. Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: action_args: {'id': '84'} Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:15.228029 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:15.229013 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.230971 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-3dcba961-3adf-4c06-b260-b1561b98c0a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:15.232258 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-3dcba961-3adf-4c06-b260-b1561b98c0a2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394060 Aug 10 08:35:15.232258 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 08:35:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:15.238017 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-b3411fc8-3e03-4516-8138-e6ef6ef4b43d admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:15.253502 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-b3411fc8-3e03-4516-8138-e6ef6ef4b43d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019066 Aug 10 08:35:15.254019 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:15.263369 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-ec7d699e-e4f3-4154-9de2-477b4d5cd3c8 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:15.278173 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-ec7d699e-e4f3-4154-9de2-477b4d5cd3c8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018274 Aug 10 08:35:15.278727 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:35:15.287599 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-00bc3242-a967-401f-98f1-d92774896d82 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:15.292787 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.wsgi [None req-00bc3242-a967-401f-98f1-d92774896d82 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-00bc3242-a967-401f-98f1-d92774896d82 admin admin] Request method failure captured: Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept: application/json Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept-Encoding: gzip, deflate Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Connection: keep-alive Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Content-Length: 0 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Host: 10.222.0.45 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-System-Scope: None Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: User-Agent: python-novaclient Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Auth-Token: gAAAAABi823CnM2KpDR2DJZcQ_s62seW4Nju9aKi3eSi0aZAQd7OXNrEb2QIjQDwRxoIqYI9K4GXlJPa8V5jCdfWwo02fSB_Nrdhgi_jXeLdTgcjpZbaz9CPkm6WD13mLrSmn-BLmYca5hXVNdzDFNfKg6Sdae5kQMxQvNPtRihNvPVYVrYYuOw Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Id: None Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Name: None Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Identity-Status: Confirmed Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Is-Admin-Project: True Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Id: default Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Name: Default Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Name: admin Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Role: admin,reader,member Aug 10 08:35:15.294808 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Roles: admin,reader,member Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant: admin Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Name: admin Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User: admin Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Id: default Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Name: Default Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Name: admin Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: method: > Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: exception: Flavor 84 could not be found. Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: action_args: {'id': '84'} Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:15.296350 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:15.297416 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:15.298805 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-00bc3242-a967-401f-98f1-d92774896d82 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:15.300290 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-00bc3242-a967-401f-98f1-d92774896d82 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012010 Aug 10 08:35:15.300290 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Wed Aug 10 08:35:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:16.255315 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-ec7d699e-e4f3-4154-9de2-477b4d5cd3c8 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:16.256359 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-ec7d699e-e4f3-4154-9de2-477b4d5cd3c8 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 10 08:35:16.256757 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:16.772094 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-221dc135-e0fa-41d9-80ee-9421702a814e admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:16.778280 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.wsgi [None req-221dc135-e0fa-41d9-80ee-9421702a814e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-221dc135-e0fa-41d9-80ee-9421702a814e admin admin] Request method failure captured: Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept: application/json Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Accept-Encoding: gzip, deflate Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Connection: keep-alive Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Content-Length: 0 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Host: 10.222.0.45 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Openstack-System-Scope: None Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: User-Agent: python-novaclient Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Auth-Token: gAAAAABi823EnJGhOqlZWyEQ4oRJAnSc2DrD9qQaKRUNENE7VBr1mZgmFuwzauOlirxuKOhRKDZ4PDNfUY5Gyt8llefB01VgTjjVIMvPJtjoHDC15FDIWruPeCmXHHtwe52svaJcaIJPY-l1SIJqrpZ6WixEpTp2opj8fGoqMSc3nLtTQjux3WQ Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Id: None Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Domain-Name: None Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Identity-Status: Confirmed Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Is-Admin-Project: True Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Id: default Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Domain-Name: Default Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Project-Name: admin Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Role: admin,reader,member Aug 10 08:35:16.779797 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Roles: admin,reader,member Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant: admin Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-Tenant-Name: admin Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User: admin Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Id: default Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Domain-Name: Default Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: X-User-Name: admin Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: method: > Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: exception: Flavor 451 could not be found. Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: action_args: {'id': '451'} Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:16.781342 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:16.783269 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.784574 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-221dc135-e0fa-41d9-80ee-9421702a814e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:16.785804 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-221dc135-e0fa-41d9-80ee-9421702a814e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386149 Aug 10 08:35:16.785804 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:35:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:16.790769 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-b4a4c43f-251a-478d-803b-051bb70b873d admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:16.805804 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-b4a4c43f-251a-478d-803b-051bb70b873d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018600 Aug 10 08:35:16.806319 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:16.815389 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:16.830460 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018504 Aug 10 08:35:16.831003 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Wed Aug 10 08:35:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:35:16.840416 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e9f31d7d-c534-4c59-aadf-f1107063fc87 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:16.845566 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.wsgi [None req-e9f31d7d-c534-4c59-aadf-f1107063fc87 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e9f31d7d-c534-4c59-aadf-f1107063fc87 admin admin] Request method failure captured: Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept: application/json Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Accept-Encoding: gzip, deflate Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Connection: keep-alive Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Content-Length: 0 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Host: 10.222.0.45 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-Api-Version: compute 2.90 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Openstack-System-Scope: None Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: User-Agent: python-novaclient Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Auth-Token: gAAAAABi823EnJGhOqlZWyEQ4oRJAnSc2DrD9qQaKRUNENE7VBr1mZgmFuwzauOlirxuKOhRKDZ4PDNfUY5Gyt8llefB01VgTjjVIMvPJtjoHDC15FDIWruPeCmXHHtwe52svaJcaIJPY-l1SIJqrpZ6WixEpTp2opj8fGoqMSc3nLtTQjux3WQ Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Id: None Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Domain-Name: None Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Identity-Status: Confirmed Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Is-Admin-Project: True Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Id: default Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Domain-Name: Default Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Project-Name: admin Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Role: admin,reader,member Aug 10 08:35:16.847163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Roles: admin,reader,member Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4075a07229a44c19829adfecb306b6b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4075a07229a44c19829adfecb306b6b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant: admin Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Id: 4075a07229a44c19829adfecb306b6b7 Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-Tenant-Name: admin Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User: admin Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Id: default Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Domain-Name: Default Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Id: 5a6ae8d3cbfd4ceca126228b9ed39b13 Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: X-User-Name: admin Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: method: > Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: exception: Flavor 451 could not be found. Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: action_args: {'id': '451'} Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:35:16.848666 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:16.849528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: ERROR nova.api.openstack.wsgi Aug 10 08:35:16.850600 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e9f31d7d-c534-4c59-aadf-f1107063fc87 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:35:16.851616 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-e9f31d7d-c534-4c59-aadf-f1107063fc87 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012127 Aug 10 08:35:16.851616 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:35:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 08:35:17.799515 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:17.800773 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Aug 10 08:35:17.801151 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:18.311578 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-d80f35e3-a23b-4116-af00-f7eaaf36212e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:35:18.449599 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-d80f35e3-a23b-4116-af00-f7eaaf36212e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.509736 Aug 10 08:35:18.450109 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 08:35:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:35:19.406582 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:19.407604 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 10 08:35:19.410015 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:19.922163 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-b2963fde-039e-4fcd-b9ac-d51461abfe08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:35:19.999073 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-b2963fde-039e-4fcd-b9ac-d51461abfe08 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.453296 Aug 10 08:35:19.999615 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 08:35:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:35:21.078550 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:21.079546 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 10 08:35:21.079929 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:21.599216 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-4374202f-6b24-40d7-9131-58a65dedcb68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:35:21.690780 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-4374202f-6b24-40d7-9131-58a65dedcb68 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.473938 Aug 10 08:35:21.691325 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 08:35:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:35:22.648668 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:22.649741 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 10 08:35:22.650132 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:23.158696 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-0945e33a-21c7-4072-a1bd-2e455c9b1cf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:35:23.221934 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-0945e33a-21c7-4072-a1bd-2e455c9b1cf2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.435978 Aug 10 08:35:23.222528 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Wed Aug 10 08:35:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:35:24.181235 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:24.182233 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 10 08:35:24.182661 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:35:24.706304 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-32aaffbb-25a9-478b-a589-9318e63072fe admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:35:24.726735 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-32aaffbb-25a9-478b-a589-9318e63072fe admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408914 Aug 10 08:35:24.727262 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Wed Aug 10 08:35:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:36:15.544275 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:15.545275 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-c401a80d-d01e-4411-ac6a-f4591d332240 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 10 08:36:15.545669 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 931 bytes} [Wed Aug 10 08:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:36:15.556729 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:15.933432 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-e229e476-9ed5-47f3-80c8-5e603cc1f64a admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:15.954416 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-e229e476-9ed5-47f3-80c8-5e603cc1f64a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402229 Aug 10 08:36:15.954973 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1292 bytes} [Wed Aug 10 08:36:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:36:15.979714 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-437d0daf-cccb-45bb-b66c-8343b3b88362 admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:15.983152 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG dbcounter [-] [110296] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110296) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:36:15.988322 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-437d0daf-cccb-45bb-b66c-8343b3b88362 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013924 Aug 10 08:36:15.988829 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 10 08:36:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:36:16.001475 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-7c771fc6-f80a-42ed-8b0d-843b6363ec64 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:16.009107 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-7c771fc6-f80a-42ed-8b0d-843b6363ec64 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011216 Aug 10 08:36:16.009629 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 10 08:36:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:36:16.021683 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:16.029685 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011598 Aug 10 08:36:16.030210 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1286 bytes} [Wed Aug 10 08:36:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:36:16.042192 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-6dfb154f-f46c-495b-9aed-3dc923bcfd71 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:36:16.050120 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-6dfb154f-f46c-495b-9aed-3dc923bcfd71 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011941 Aug 10 08:36:16.050649 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1283 bytes} [Wed Aug 10 08:36:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:39:33.664044 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:33.665731 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Aug 10 08:39:33.666379 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:39:33.805249 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_api:SELECT=6 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:33.961757 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:33.964251 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:39:33.964251 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:39:33.965418 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:33.965909 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:33.966319 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:33.967061 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:33.970809 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:33.970809 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:34.002144 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-6d29041f-e58d-40a2-9660-db94c6bc8a7a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198365 Aug 10 08:39:34.002800 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:39:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:39:34.824364 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:34.825368 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 08:39:34.825756 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:39:35.015356 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:35.017775 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:39:35.017775 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:39:35.018863 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:35.019335 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:35.019758 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:35.020523 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:35.020968 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:35.021381 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:35.040286 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-a732722c-1758-4850-a17d-bec07470687a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076224 Aug 10 08:39:35.041074 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:39:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 08:39:46.273464 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:46.274528 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 08:39:46.274918 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:39:46.416856 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_cell0:SELECT=4 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:46.417612 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_cell1:SELECT=4 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:46.418229 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG dbcounter [-] [110295] Writing DB stats nova_api:SELECT=8 {{(pid=110295) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:39:46.465286 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:46.467700 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:39:46.467700 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:39:46.468841 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:46.469849 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:46.470293 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:46.471026 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:46.471464 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:46.471873 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:46.497060 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-62584762-1022-4818-b25f-c5ad08c51a2c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084837 Aug 10 08:39:46.497539 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:39:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:39:47.320926 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: DEBUG nova.api.openstack.wsgi [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] Calling method '>' {{(pid=110296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:47.321932 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: INFO nova.api.openstack.requestlog [None req-313a9d46-dfe8-4ac8-9862-b12838e730ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 10 08:39:47.322322 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: [pid: 110296|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Wed Aug 10 08:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:39:47.509875 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG nova.api.openstack.wsgi [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Calling method '>' {{(pid=110295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:39:47.512313 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 08:39:47.512313 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: warnings.warn(msg) Aug 10 08:39:47.513454 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:47.513918 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:47.514343 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:47.515072 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:39:47.515514 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:39:47.516606 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: DEBUG oslo_concurrency.lockutils [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:39:47.537808 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: INFO nova.api.openstack.requestlog [None req-b5206ec4-4b63-42d2-867f-0967e5fa5cb1 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078188 Aug 10 08:39:47.538275 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: [pid: 110295|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Wed Aug 10 08:39:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:40:44.115725 dv-cinder-781024-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 08:40:44.116259 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: Wed Aug 10 08:40:44 2022 - graceful shutdown triggered... Aug 10 08:40:44.116695 dv-cinder-781024-3-iscsi devstack@n-api.service[110295]: Gracefully killing worker 1 (pid: 110295)... Aug 10 08:40:44.117053 dv-cinder-781024-3-iscsi devstack@n-api.service[110296]: Gracefully killing worker 2 (pid: 110296)... Aug 10 08:40:45.117175 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: worker 1 buried after 1 seconds Aug 10 08:40:45.117587 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: worker 2 buried after 1 seconds Aug 10 08:40:45.117587 dv-cinder-781024-3-iscsi devstack@n-api.service[110294]: goodbye to uWSGI. Aug 10 08:40:45.118808 dv-cinder-781024-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 08:40:45.119363 dv-cinder-781024-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 08:40:45.122226 dv-cinder-781024-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 08:40:45.132119 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 08:40:45 2022] *** Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: nodename: dv-cinder-781024-3-iscsi Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: machine: x86_64 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: clock source: unix Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: pcre jit disabled Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: detected number of CPU cores: 4 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: current working directory: / Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: detected binary path: /usr/bin/uwsgi-core Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: your processes number limit is 47680 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: your memory page size is 4096 bytes Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: detected max file descriptor number: 2048 Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: lock engine: pthread robust mutexes Aug 10 08:40:45.134350 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: thunder lock: enabled Aug 10 08:40:45.135516 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 08:40:45.135516 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 08:40:45.176288 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: Python main interpreter initialized at 0x55b56d1559c0 Aug 10 08:40:45.176288 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: python threads support enabled Aug 10 08:40:45.176288 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: your server socket listen backlog is limited to 100 connections Aug 10 08:40:45.176288 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: your mercy for graceful operations on workers is 90 seconds Aug 10 08:40:45.176687 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 08:40:45.176772 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: *** Operational MODE: preforking *** Aug 10 08:40:45.194581 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: *** uWSGI is running in multiple interpreter mode *** Aug 10 08:40:45.194581 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: spawned uWSGI master process (pid: 124792) Aug 10 08:40:45.194581 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: spawned uWSGI worker 1 (pid: 124809, cores: 1) Aug 10 08:40:45.194581 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: spawned uWSGI worker 2 (pid: 124810, cores: 1) Aug 10 08:40:45.194581 dv-cinder-781024-3-iscsi devstack@n-api.service[124792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 08:40:45.177180 dv-cinder-781024-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 08:40:45.839333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 08:40:45.842783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 08:40:46.987245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:40:46.987245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: from cryptography.utils import int_from_bytes Aug 10 08:40:46.987875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:40:46.987875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: from cryptography.utils import int_from_bytes Aug 10 08:40:46.995644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:40:46.995644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: from cryptography.utils import int_from_bytes Aug 10 08:40:46.996084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 08:40:46.996084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: from cryptography.utils import int_from_bytes Aug 10 08:40:49.324720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:40:49.325300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:40:49.325504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:40:49.325872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:40:49.326132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:40:49.326554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.326884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.327210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.327532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.327870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.328190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.328515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.328838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.329169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.329437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.329754 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.330082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-3-iscsi {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.330220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 08:40:49.330645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.330743 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 08:40:49.330841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.331010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 08:40:49.331134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.331367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.331460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 08:40:49.331620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 08:40:49.331719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.331990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332101 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.332924 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.333251 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.333560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.333666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.333878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.333988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.334944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-3-iscsi {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.335882 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336625 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336827 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-3-iscsi {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.336965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.337114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.337284 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.337433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.337752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.337848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.338170 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.338510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.339004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.339146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.339484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.339645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.339946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.340938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.341066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.341267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.341407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.341592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.341762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.343041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-3-iscsi {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.344989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.345973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.346845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.347930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348248 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348354 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348674 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.348988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.349727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.349850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350756 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.350953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.351121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.351377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.351471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.351692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.351811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.352038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.352364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.352677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.353021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.353352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.353667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.353984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.354299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.354652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.354993 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355550 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.355966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.356169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.356350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.356518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.356717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.356815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357059 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.357794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358689 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.358785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359119 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.359999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.360965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.361941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362366 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.362917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.363999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.364162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.364322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.364478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.364622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.365336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.365489 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.365655 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.365813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.366007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.366154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.366274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.366384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.375778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.375961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.376869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377599 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.377905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.378865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379599 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.379997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380528 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.380916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.381037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.381203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.381306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.381408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.381502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.381593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.381726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.381946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.382105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.382208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.382294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.382386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.382555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.382717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.382856 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.382986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.383113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.383241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.383457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.383457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.383715 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.383851 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.383987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.384117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.384353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.384508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.384695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.384695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.384695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.385292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.385507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.385664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.386177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.386336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.386544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.386753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.386911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.387056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.387056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.387358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.387503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.387659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.387810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.387966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.388108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.388249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.388390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.388548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.388705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.388848 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.389051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.389194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.389386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.389386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.389673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.389815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.389974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.390071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.390165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.390297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 08:40:49.390457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.390724 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.390888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391321 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391677 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.391861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392014 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392110 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.392933 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.393869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394001 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394702 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.394831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.395999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396259 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396259 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.396900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397310 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397566 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.397961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.398946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399075 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399338 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399852 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.399970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400574 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.400911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401468 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.401919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.402654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.405629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.405789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.405900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.405988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406428 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406545 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406689 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.406957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407846 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.407936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408305 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408645 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.408993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.409931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410014 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.410829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.411047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.411161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.411296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.411392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.411478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412313 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412776 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.412944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413742 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.413971 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414341 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.414984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.415987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416349 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416700 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.416918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.417129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.417224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.417997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.418988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.419861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420011 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420469 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.420910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.421857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422189 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.422955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423535 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.423825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424586 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.424938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425722 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425910 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.425995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.426859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.427102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.427281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.428028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.428137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.428278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.428407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.428716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.429035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.429192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.429470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.429791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.429945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.430087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.430205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.430446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433887 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.433979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.434988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435385 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.435982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.436956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437048 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.437893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438106 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.438919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.439928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440402 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.440884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.441998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.442119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.442318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.442420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.442697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.442823 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443133 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443349 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.443974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444076 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444283 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.444903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.445959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.446104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.446372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.446537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.446733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.446866 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.447809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448402 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448666 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.448995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.449139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.449794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.449959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.450967 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.451260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.451406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.451538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.451667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452534 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.452653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.453543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.453718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.453867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454775 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.454933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455528 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.455895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.456054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.456221 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.458556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.458666 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.458767 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.458854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.458939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459704 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.459943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460092 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460620 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460844 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.460999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461238 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461472 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461889 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.461961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.462968 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463662 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.463973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464305 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.464903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465032 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465540 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.465854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.466036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.466184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.466369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.468902 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469240 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469737 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.469881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.470907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.471959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.472920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.473270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.473473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.473622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.473773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.473928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.474596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.474750 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475111 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475426 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.475871 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476472 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.476865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.477937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.478087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.478397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.478602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.478757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.478910 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.479999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.480986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481959 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.481959 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482833 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.482992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.483383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.483581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.483739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.483883 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484330 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.484866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.485035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.485359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.485520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.485716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.485872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.486979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487580 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.487906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488352 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.488928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.489094 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.489246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.489398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.489543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.489756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.490524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.490696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.490842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.490986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491743 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.491887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.492037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.492181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.492355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.493762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.493934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.494877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.495039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.495195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.495439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.495731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.495891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.496952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.497178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.497334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.497334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.497334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.497897 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.498969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499724 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.499875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.500880 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501029 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.501872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502330 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.502963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.503959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504537 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.504974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.505117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.505268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.505587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.505739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.506963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.507116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.507386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.507539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.507695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.507859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508469 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.508920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509680 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.509861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.510852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.511925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.512910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.513054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.513206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.513365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.513509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.513901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.514096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.514246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.514398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.514588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.514735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.515959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.516981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517276 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.517963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.518935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519080 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.519970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.520881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521101 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.521857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522904 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.522904 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.523187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.523187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.523468 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.523612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.523773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.524917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.525061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.525253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.525405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.525549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.525549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.526235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.526505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.526505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.526854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527197 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527745 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.527901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528092 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528248 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.528849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529715 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.529867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.530973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.531125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.531325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.531474 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.531762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.531927 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532467 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532586 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532701 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532821 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.532943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533776 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.533886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.534374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.534600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.534720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.538023 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.538520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.538688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.538852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.538999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539589 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539743 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.539896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.540934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541086 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.541908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.542231 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.542389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.542582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.542739 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.542891 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.543944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.544127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.544524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.544683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.544828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.544970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.545907 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.546060 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.546216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.546539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.546813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.546963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.547114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.547272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.547444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.547665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.548991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.549965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.550987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551463 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.551779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.552073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.555639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.555879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.556059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.556220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.556388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.556670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.556862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.557147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.557300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.557459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.557611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.557867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.558959 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559261 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.559873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.560865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.561959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.562148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.562307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.562457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.562676 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.562876 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.563868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.564911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.565284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.565463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.565615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.565779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.565973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.566137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.566322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.566512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.566697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.567027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.567289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.567444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.567601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.567760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.568971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.569268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.569418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.569579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.569738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.569898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.570093 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.570325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.570534 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.570691 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.570841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571673 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571673 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.571968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.572964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573264 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.573870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574574 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.574898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.575110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.575516 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.575748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.575905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.575905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.576206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.576365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.576525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.576705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.576860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.577136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.577314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.577563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.577718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.577876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.578053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.578391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.578619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.578786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.578946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.579132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.579297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.579458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.579618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.579777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.581958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.582132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.582299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.582525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.582758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.582922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.583074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.583237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.583922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.584866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.585063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.585220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.585220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.585741 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.585903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.586952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.587234 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.587402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.587580 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.587818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.587974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.588135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.588305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.588605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.588761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.588911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.589855 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.590888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591661 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.591988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.592934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593461 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593613 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593613 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.593920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.594935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.595139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.595294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.595468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.595838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.595981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.596993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.597314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.597563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.597563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.597977 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.598143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.598303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.598498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.598942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.599187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.599843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.599997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600471 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.600922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.601965 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.602317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.602675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.602842 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603238 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.603882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604814 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.604966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.605132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.605349 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.605503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.605654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.606105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.606258 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.606420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.606664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.606834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.607049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.607223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.607376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.607559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.607559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.608026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.608199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.608493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.608648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609271 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.609726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.610888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.611879 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612200 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612360 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.612975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.613919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.614071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.614222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.614383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.614577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.614793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.615921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.616889 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.617062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.618407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 08:40:49.620072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 08:40:49.753027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO dbcounter [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Registered counter for database nova_api Aug 10 08:40:49.758255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO dbcounter [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Registered counter for database nova_api Aug 10 08:40:49.773506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.777590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_db.sqlalchemy.engines [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.780331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writer thread running {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:49.784205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writer thread running {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:49.837498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.context [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9b14cff7-dd7a-4ce6-bf18-ff6ec854a829(cell1) {{(pid=124809) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 08:40:49.840303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.context [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9b14cff7-dd7a-4ce6-bf18-ff6ec854a829(cell1) {{(pid=124810) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 08:40:49.841596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:40:49.842077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:40:49.843759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:40:49.844324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:40:49.844444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:40:49.844836 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:40:49.844955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:40:49.846441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:40:49.846865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:40:49.847183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:40:49.847635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:40:49.848916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO dbcounter [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Registered counter for database nova_cell0 Aug 10 08:40:49.849649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:40:49.851710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO dbcounter [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Registered counter for database nova_cell0 Aug 10 08:40:49.853009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO dbcounter [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Registered counter for database nova_cell1 Aug 10 08:40:49.855824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO dbcounter [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Registered counter for database nova_cell1 Aug 10 08:40:49.860315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.861531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.866079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_db.sqlalchemy.engines [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.866880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_db.sqlalchemy.engines [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:49.867789 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writer thread running {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:49.873345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writer thread running {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:49.875977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writer thread running {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:50.008960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writer thread running {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:50.019476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO dbcounter [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Registered counter for database nova_cell0 Aug 10 08:40:50.021612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO dbcounter [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Registered counter for database nova_cell0 Aug 10 08:40:50.026278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_db.sqlalchemy.engines [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:50.028244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_db.sqlalchemy.engines [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 08:40:50.031008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writer thread running {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:50.032728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writer thread running {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 08:40:50.351984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: WARNING keystonemiddleware.auth_token [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:40:50.355220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: WARNING keystonemiddleware.auth_token [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:40:50.359476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: WARNING keystonemiddleware.auth_token [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:40:50.362592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: WARNING keystonemiddleware.auth_token [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:40:50.702315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: WARNING keystonemiddleware.auth_token [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:40:50.711431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: WARNING keystonemiddleware.auth_token [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 08:40:50.714451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: WARNING keystonemiddleware.auth_token [None req-c6dba025-d738-4c32-b6ef-a933a15f3c71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:40:50.717480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: WARNING keystonemiddleware.auth_token [None req-ccf3b596-509d-4c3c-89c4-f0a7d5fdb494 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 08:40:50.720707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b56d1559c0 pid: 124810 (default app) Aug 10 08:40:50.724125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b56d1559c0 pid: 124809 (default app) Aug 10 08:41:27.162864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.163769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.164722 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:27.165516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:28.621271 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6addb65a-af2f-4982-8bd0-ea5292d74185 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Action: 'create', calling method: .version_select at 0x7fdef79cddc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2106285957", "metadata": {"Type": "work"}}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6addb65a-af2f-4982-8bd0-ea5292d74185 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 122 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:41:28.627309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2106285957", "metadata": {"Type": "work"}}} Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: Aug 10 08:41:28.629231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2106285957', 'metadata': {'Type': 'work'}}}} Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise error Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:28.633278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 08:41:28.635718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 08:41:28.637057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 08:41:28.637057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:28.637057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6addb65a-af2f-4982-8bd0-ea5292d74185 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:28.637057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6addb65a-af2f-4982-8bd0-ea5292d74185 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.476494 Aug 10 08:41:28.637057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 08:41:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1478 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:41:29.036998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8797c593-ebc7-4e37-b424-23746ceaba05 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Action: 'create', calling method: .version_select at 0x7fdef7aa68b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304603498", "metadata": {"Type": "work"}}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8797c593-ebc7-4e37-b424-23746ceaba05 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 120 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:41:29.046859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304603498", "metadata": {"Type": "work"}}} Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:41:29.048222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1304603498', 'metadata': {'Type': 'work'}}}} Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise error Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi '0' Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:29.049185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 08:41:29.050527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 08:41:29.053386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 08:41:29.053386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.053386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8797c593-ebc7-4e37-b424-23746ceaba05 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:29.053386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8797c593-ebc7-4e37-b424-23746ceaba05 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.412164 Aug 10 08:41:29.053386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 08:41:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:41:29.059085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0c5faf18-c858-4027-8536-65a7059efc01 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Action: 'create', calling method: .version_select at 0x7fdef78d98b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-144655337", "metadata": {"Type": "work"}}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0c5faf18-c858-4027-8536-65a7059efc01 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 118 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:41:29.063062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-144655337", "metadata": {"Type": "work"}}} Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: Aug 10 08:41:29.064361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-144655337', 'metadata': {'Type': 'work'}}}} Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise error Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi '' Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:29.065211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 08:41:29.066580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 08:41:29.068669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 08:41:29.068669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:29.068669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0c5faf18-c858-4027-8536-65a7059efc01 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:29.068669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0c5faf18-c858-4027-8536-65a7059efc01 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009198 Aug 10 08:41:29.070652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 08:41:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:41:29.076736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-76ec5d45-9338-40c5-bd80-1ee7a086d4c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Calling method '.version_select at 0x7fdef7a31f70>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:29.111032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:29.114437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:29.114437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:29.114437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:30.405636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-76ec5d45-9338-40c5-bd80-1ee7a086d4c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] HTTP exception thrown: Volume tempest-invalid-103348799 could not be found. Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-76ec5d45-9338-40c5-bd80-1ee7a086d4c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-103348799 HTTP/1.1 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:41:30.411261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Volume tempest-invalid-103348799 could not be found. Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'tempest-invalid-103348799'} Aug 10 08:41:30.412710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-103348799 could not be found. (HTTP 404) (Request-ID: req-25ddeafa-14c8-40e6-bc1a-4321a94479cb) Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:30.413374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:41:30.414581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-103348799 could not be found. Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:41:30.415778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-103348799 could not be found. Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-103348799 could not be found. Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-76ec5d45-9338-40c5-bd80-1ee7a086d4c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 404 to user: Volume tempest-invalid-103348799 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-76ec5d45-9338-40c5-bd80-1ee7a086d4c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-103348799" status: 404 len: 98 microversion: 2.1 time: 1.340166 Aug 10 08:41:30.416923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1215 bytes} [Wed Aug 10 08:41:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-103348799 => generated 98 bytes in 1342 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 08:41:30.429404 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a4fb28c9-aad0-4281-8865-4ca6fe088b7c tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009425 Aug 10 08:41:30.434250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 10 08:41:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 08:41:30.442650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b507e781-3c05-478c-a598-f324d65dcd8d tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004394 Aug 10 08:41:30.443389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1137 bytes} [Wed Aug 10 08:41:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 08:41:30.454634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6b94d8be-4d1a-44ec-b651-fa5746ce40c6 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Calling method '.version_select at 0x7fdef788ab80>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:31.510608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-6b94d8be-4d1a-44ec-b651-fa5746ce40c6 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] HTTP exception thrown: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6b94d8be-4d1a-44ec-b651-fa5746ce40c6 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/os-volumes/d6c8df92-2e49-45b0-a697-9f7291ed0b10 HTTP/1.1 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:41:31.516684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'd6c8df92-2e49-45b0-a697-9f7291ed0b10'} Aug 10 08:41:31.517720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. (HTTP 404) (Request-ID: req-7877c212-c8eb-44e3-a89c-6e68409ece72) Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.518328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:41:31.519225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 08:41:31.520684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6b94d8be-4d1a-44ec-b651-fa5746ce40c6 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 404 to user: Volume d6c8df92-2e49-45b0-a697-9f7291ed0b10 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6b94d8be-4d1a-44ec-b651-fa5746ce40c6 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/d6c8df92-2e49-45b0-a697-9f7291ed0b10" status: 404 len: 109 microversion: 2.1 time: 1.070119 Aug 10 08:41:31.521566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:41:30 2022] DELETE /compute/v2.1/os-volumes/d6c8df92-2e49-45b0-a697-9f7291ed0b10 => generated 109 bytes in 1072 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:41:31.530367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-90667167-12e2-4353-b8d8-6dba9d7d87c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Calling method '.version_select at 0x7fdef77d5a60>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:31.643076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-90667167-12e2-4353-b8d8-6dba9d7d87c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] HTTP exception thrown: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-90667167-12e2-4353-b8d8-6dba9d7d87c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Request method failure captured: Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/os-volumes/59359310-bd4f-4803-a268-40a0ccc6e1ca HTTP/1.1 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi8283ilEzHpJuXjhOIiPfn58EdqKC_HNbvbYWh3Er5xHwsQXatqQ9kW49gXg_lHHXQkj2zGdFzCpOupw5iBrBRQUDhR7oKfMNEVeKaCSVUrfIkh4DRKH8TR6TfG6ZJlW9s-5zohYzMuMQL0HQE_5put6RuKaKFpXTO3l5g7gMtDAe3Ug Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:41:31.647520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d9bd87e8826b4d4b8b0412c05dcc7c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d9bd87e8826b4d4b8b0412c05dcc7c76", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: d9bd87e8826b4d4b8b0412c05dcc7c76 Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesNegativeTest-1234853908 Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: b2791f0335c94665b07214993ab46638 Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesNegativeTest-1234853908-project Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '59359310-bd4f-4803-a268-40a0ccc6e1ca'} Aug 10 08:41:31.648713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. (HTTP 404) (Request-ID: req-2b040f1d-baf3-4c17-86a0-1f2427763583) Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.649314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:41:31.650263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 08:41:31.651869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-90667167-12e2-4353-b8d8-6dba9d7d87c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] Returning 404 to user: Volume 59359310-bd4f-4803-a268-40a0ccc6e1ca could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-90667167-12e2-4353-b8d8-6dba9d7d87c3 tempest-VolumesNegativeTest-1234853908 tempest-VolumesNegativeTest-1234853908-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/59359310-bd4f-4803-a268-40a0ccc6e1ca" status: 404 len: 109 microversion: 2.1 time: 0.121507 Aug 10 08:41:31.652961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:41:31 2022] GET /compute/v2.1/os-volumes/59359310-bd4f-4803-a268-40a0ccc6e1ca => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:41:37.165603 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1486301743", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "networks": [{"uuid": "1297645f-a0d6-4fd9-ba54-798372ab9964"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:37.356794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] validate_networks() for [('1297645f-a0d6-4fd9-ba54-798372ab9964', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:41:39.353581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:41:39.354775 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:41:39.355390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:41:39.355935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:41:39.356515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:41:39.388049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:39.390062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:39.391944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:39.393894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:39.394687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:39.399759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:39.462134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Getting quotas for project be3bd9804f144d64aa4984a3ba0e6e2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:39.477936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Getting quotas for user 527fdf5cf2af40c893b0e4ef9dc4e486 and project be3bd9804f144d64aa4984a3ba0e6e2b. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:39.506443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:41:39.513403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:41:39.733930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6068ad6a-7aac-4dc4-8f8b-bf5cd411eab1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.775280 Aug 10 08:41:39.736053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 5/9] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:41:39.749038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6da423a3-87e4-427f-93c0-562bbe324dd5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:39.750632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6da423a3-87e4-427f-93c0-562bbe324dd5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:40.219101 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6da423a3-87e4-427f-93c0-562bbe324dd5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:40.239125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6da423a3-87e4-427f-93c0-562bbe324dd5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1215 microversion: 2.1 time: 0.494302 Aug 10 08:41:40.249960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:39 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1215 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:41.274667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ca82b16f-5a58-4f88-8050-17d95302c646 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:41.277538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ca82b16f-5a58-4f88-8050-17d95302c646 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:41.783738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ca82b16f-5a58-4f88-8050-17d95302c646 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:41.816867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ca82b16f-5a58-4f88-8050-17d95302c646 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1215 microversion: 2.1 time: 0.546590 Aug 10 08:41:41.817707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:41 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1215 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:41.962051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c3faeffa-eec7-4f2f-b888-c0bfe6b3925d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: .version_select at 0x7fdef77dff70>, body: {"keypair": {"name": "tempest-keypair-205471185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0gd6bD0X2Giaax2kaxnbaYKMOIseRJvhUVJxzaf0zrdCqSH6blUiMVAkztdApxUAB9w0HRgfDSTri+SUXuClROMwFS442JdJ5Cwx70bBtvBeBMsfEqbGX/lHDfiQ88yA=="}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:42.094252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-c3faeffa-eec7-4f2f-b888-c0bfe6b3925d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:42.106791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-c3faeffa-eec7-4f2f-b888-c0bfe6b3925d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for user 661a67fbdd6941889c706d2560c920a2 and project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:42.300122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c3faeffa-eec7-4f2f-b888-c0bfe6b3925d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.719561 Aug 10 08:41:42.302366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 6/12] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:41:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:41:42.844822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:42.844822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:42.856071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:42.857063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:42.857705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:42.863816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:42.864769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:42.870183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:43.299459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:43.321085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-95c143fd-e67e-4767-ae4a-f53a80d8d929 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1219 microversion: 2.1 time: 0.485197 Aug 10 08:41:43.337636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:42 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1219 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:44.345365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:44.346062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:44.355607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:44.356107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:44.357007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:44.359294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:44.361323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:44.364507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:44.764869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-829121014", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:44.813350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:44.855084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5c67d6a5-53ce-4504-8c78-e5d679885e3f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1211 microversion: 2.1 time: 0.513610 Aug 10 08:41:44.857047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] validate_networks() for [('7368b221-cd07-48e6-8da6-73e91306248e', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:41:44.861520 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 7/14] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:44 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1211 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:44.976939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8006dcde-3493-402b-9e7d-cc4555eea4be tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: .version_select at 0x7fdef6eab820>, body: {"keypair": {"name": "tempest-keypair-1487756703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgA8/pgpimtdB1GFHatJ9a6LV0+k/PuA2lBHHJZwXVciwW/snBGN3wg7c2SfGQ0HCYh2DKJFvklOnh6ahP6a21uDlun+klBRFLe9+48k0h7MzAiraN+gxt05W+Dyne0ZA=="}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:45.027452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-8006dcde-3493-402b-9e7d-cc4555eea4be tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for project a1554973bf4b4523b966a9d851b0244a. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:45.033862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-8006dcde-3493-402b-9e7d-cc4555eea4be tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for user 0c316e7b121b4d859d9677edcb49be45 and project a1554973bf4b4523b966a9d851b0244a. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:45.179940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8006dcde-3493-402b-9e7d-cc4555eea4be tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.317188 Aug 10 08:41:45.181796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 8/15] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 10 08:41:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 08:41:45.887127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:45.887127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:45.904257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:45.904911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:45.905501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:45.906325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:45.906920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:45.907546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:45.978759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:41:45.979248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:41:45.979931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:41:45.980359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:41:45.980789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:41:46.002905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:46.007307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:46.009045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:46.011304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:46.014070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:46.018863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:46.092285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:46.103286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:46.104533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for user d28b7a7b2e0143cf9ee6e761eb7fb281 and project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:46.116416 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9bf4a72d-1195-4bf7-a931-d4637dd47183 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1275 microversion: 2.1 time: 0.235338 Aug 10 08:41:46.121808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 9/16] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:45 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:46.151269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:41:46.161328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:41:46.362619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3b7ba4fc-0baa-4bc1-a190-22f5e38949ad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.845493 Aug 10 08:41:46.362619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 8/17] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:41:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:41:46.372287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7142351e-9226-4b70-9121-1106630f0f01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:46.372906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7142351e-9226-4b70-9121-1106630f0f01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:46.616577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7142351e-9226-4b70-9121-1106630f0f01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:46.623797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7142351e-9226-4b70-9121-1106630f0f01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1221 microversion: 2.1 time: 0.255335 Aug 10 08:41:46.624387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 10/18] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:46 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1221 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:47.086169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1265335691", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:47.148256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:47.149326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:47.157708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] validate_networks() for [('7368b221-cd07-48e6-8da6-73e91306248e', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:41:47.163746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:47.164317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:47.164952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:47.165678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:47.166214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:47.171527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:47.354454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:47.368893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-44a9cc55-6312-4d8f-93c9-7ea0a888de92 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1273 microversion: 2.1 time: 0.228097 Aug 10 08:41:47.376480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 11/19] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:47 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:48.147235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:41:48.147804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:41:48.148267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:41:48.153989 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:41:48.153989 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:41:48.166279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:48.169357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:48.169819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:48.178992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:48.178992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:48.178992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:48.219939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:48.242995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for user d28b7a7b2e0143cf9ee6e761eb7fb281 and project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:48.286316 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:41:48.293531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:41:48.397896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:48.399117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:48.413601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:48.414825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:48.420994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:48.422663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:48.423751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:48.424651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:48.568690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-755a47d6-a472-4159-a212-9c8356d976a1 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.487394 Aug 10 08:41:48.577259 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 9/20] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:41:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:41:48.609735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5c081276-79b3-4628-955c-6a0c8be4e0bb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:48.610637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5c081276-79b3-4628-955c-6a0c8be4e0bb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:48.845332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5c081276-79b3-4628-955c-6a0c8be4e0bb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:48.887580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5c081276-79b3-4628-955c-6a0c8be4e0bb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1222 microversion: 2.1 time: 0.304060 Aug 10 08:41:48.888197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 10/21] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:48 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1222 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:49.298021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1185415494", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15649ad6-aa57-44da-8ef2-51bdc24d542a"}], "security_groups": [{"name": "tempest-securitygroup--1332548537"}], "key_name": "tempest-keypair-205471185", "user_data": "}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:49.634597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:49.649422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-98e555fc-95cb-4af8-9752-ba68d651ef1f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 1.260316 Aug 10 08:41:49.671847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 12/22] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:48 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:49.763242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] validate_networks() for [('15649ad6-aa57-44da-8ef2-51bdc24d542a', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:41:49.913085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e68c7dae-d29c-44d5-9aba-d5248cc1b9bf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:49.914211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e68c7dae-d29c-44d5-9aba-d5248cc1b9bf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:50.119167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e68c7dae-d29c-44d5-9aba-d5248cc1b9bf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:50.128112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e68c7dae-d29c-44d5-9aba-d5248cc1b9bf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1222 microversion: 2.1 time: 0.220547 Aug 10 08:41:50.130759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 13/23] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:49 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:50.686388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:50.686388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:50.694760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:50.699252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:50.699751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:50.700536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:50.701034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:50.701496 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:50.790144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:41:50.790799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:41:50.791550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:41:50.793059 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:41:50.793748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:41:50.815707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:50.816661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:50.817884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:50.818917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:50.839006 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:50.839945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:50.893655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:50.904624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for user 661a67fbdd6941889c706d2560c920a2 and project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:50.931009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:41:50.935111 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:41:51.212543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-63fdfb3f-f397-459c-9f87-fb1eea4147cc tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.920303 Aug 10 08:41:51.214179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 11/24] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:41:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 08:41:51.304056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:51.309135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:51.340426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:51.342947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:51.343452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:51.345796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:51.346256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:51.346708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:51.732999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:51.752388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-071ea25d-3c43-4050-94e6-ddfd7ad1b500 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1226 microversion: 2.1 time: 0.500225 Aug 10 08:41:51.771878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:51 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1226 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:51.786644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:51.796571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-696042c9-3d56-4320-9009-0f9b372f77a0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:51.800868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-96cbb345-b2ff-4495-b75e-a94e3d76dc3c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 1.121685 Aug 10 08:41:51.801692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:50 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:51.821281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-696042c9-3d56-4320-9009-0f9b372f77a0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:51.848352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1983802163", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "090e2965-bc3f-4473-8c31-dcabdd9a7691"}], "security_groups": [{"name": "tempest-securitygroup--1333731578"}], "key_name": "tempest-keypair-1487756703", "user_data": "}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:52.100333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-696042c9-3d56-4320-9009-0f9b372f77a0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:52.118746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-696042c9-3d56-4320-9009-0f9b372f77a0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1237 microversion: 2.1 time: 0.344060 Aug 10 08:41:52.135341 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 13/27] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:51 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1237 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:52.420951 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] validate_networks() for [('090e2965-bc3f-4473-8c31-dcabdd9a7691', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:41:52.776534 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:52.778063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:52.785535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:52.786936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:52.787808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:52.790296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:52.791608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:52.792386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:53.529044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:53.548551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c2419409-773c-475b-aa1e-354a39057e98 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1274 microversion: 2.1 time: 0.769897 Aug 10 08:41:53.549212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 14/28] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:52 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1274 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:53.588109 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:53.591379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:53.620423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:53.623952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:53.624828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:53.626891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:53.632221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:53.633029 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:54.761803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:41:54.762944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:41:54.763571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:41:54.764130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:41:54.764703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:41:54.777215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:54.777703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:54.778306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:54.779279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:54.779961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:54.780571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:54.827102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for project a1554973bf4b4523b966a9d851b0244a. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:41:54.833274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for user 0c316e7b121b4d859d9677edcb49be45 and project a1554973bf4b4523b966a9d851b0244a. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:41:54.849787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:41:54.854344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:41:54.912675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:54.921580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-491df611-c77e-44f7-beba-95273dcea279 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 1.353505 Aug 10 08:41:54.926868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:53 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:54.950237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:54.950907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:54.983713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:54.984423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:54.984958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:54.989148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:54.991017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:54.991562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.140223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:55.167012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b2bef40e-bbc3-4c4b-b80a-4875cbc973aa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1289 microversion: 2.1 time: 0.237218 Aug 10 08:41:55.169319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 16/30] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:54 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1289 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:55.177500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:55.178114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:55.197359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.197861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.198303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.199320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.199766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.200191 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.203215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-15b5925c-e969-4a7f-86f4-c30b35a2b753 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.379268 Aug 10 08:41:55.216094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 15/31] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 10 08:41:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3397 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 08:41:55.399474 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:55.408211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ee172541-2801-4bc8-8410-54a6ea0d5b45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1280 microversion: 2.1 time: 0.237746 Aug 10 08:41:55.422635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 17/32] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:55 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:55.453347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:55.458637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:55.512083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c79780-62f6-4085-9cd0-30550cf68695", "tag": "acc60288-26b4-4b95-b6ab-83d4f33a680e"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:55.611287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.617942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.619933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.743759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Creating event network-changed:acc60288-26b4-4b95-b6ab-83d4f33a680e for instance d1c79780-62f6-4085-9cd0-30550cf68695 on hv-cinder-78102 Aug 10 08:41:55.749161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 08:41:55.755564 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-c2a0fe15-7eed-4c0e-9cd3-3249353b8d86 req-0f9fcb5c-7531-4c0e-9c2a-669f0ac48806 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 08:41:55.773382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.773382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.773382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.773382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.773382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.775459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.794948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.compute.rpcapi [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 08:41:55.794948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] Releasing lock "compute-rpcapi-router" {{(pid=124809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 08:41:55.834145 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b660ca89-ba1d-4813-a7c8-5c9876c1f030 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.616031 Aug 10 08:41:55.868866 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 16/33] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:41:55.949835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:55.950372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:55.953555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:55.967077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:55.974607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.975135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.975604 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:55.983231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:55.984699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-11fb721d-07bb-4480-bc3a-7a65caebc9e6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1282 microversion: 2.20 time: 0.554309 Aug 10 08:41:55.985864 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:55.987535 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:55.988245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 18/34] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:41:55 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1282 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:41:55.988855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:56.187857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:56.188483 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:56.200728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:56.201236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:56.201688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:56.202551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:56.203024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:56.214907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:56.455931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:56.465847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-92e27d73-1844-4835-9bf9-31b4a3d5d728 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.520248 Aug 10 08:41:56.485634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 17/35] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:55 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:56.492725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:56.502392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:56.517276 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:56.517794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:56.518283 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:56.530761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:56.531334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:56.534404 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:56.808010 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:56.813398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:56.822428 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1f1aa1b3-56c7-4495-bdff-92898ec898b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1280 microversion: 2.1 time: 0.347151 Aug 10 08:41:56.836567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 18/36] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:56 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:56.848658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4ba0cbd4-2f65-47a1-82e6-a0b7d4131f69 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1297 microversion: 2.1 time: 0.646074 Aug 10 08:41:56.850718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 19/37] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:56 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1297 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:57.014953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:57.015576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:57.416927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:57.440112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:57.446454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:57.451235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-783505ea-fec8-4f46-8f4e-b2b837b31a6a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1282 microversion: 2.20 time: 0.436977 Aug 10 08:41:57.451235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 19/38] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:41:57 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:41:57.494013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:57.494713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:57.496873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:41:57.510084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:57.520811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:57.521942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:57.523007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:57.523583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:57.524112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:57.844987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:57.845610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:57.860203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:57.863463 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:57.864435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:57.865482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:57.866115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:57.867958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:58.093932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.110980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-26f10bca-818e-4217-9917-0fcf6358be78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.269721 Aug 10 08:41:58.124831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:57 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:58.129666 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:58.130288 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:58.145419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:58.145930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:58.146716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:58.147513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:58.147990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:58.148744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:58.239739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.248286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7116610f-d503-4649-aea6-77d385ed6524 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1295 microversion: 2.1 time: 0.135684 Aug 10 08:41:58.249180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:58 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:58.283024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.298290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dce8af01-d182-465b-874a-812b9b57ea73 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.809662 Aug 10 08:41:58.299253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:57 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:41:58.475132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:58.475806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:58.482584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:58.483085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:58.483527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:58.484227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:58.484718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:58.485143 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:58.562301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.573057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.574984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:58.576195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-84ac4d24-2143-4a18-aefd-b6b56b4695de tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.108105 Aug 10 08:41:58.578515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:41:58 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:41:59.131651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:59.132317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:59.139800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.140295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.140736 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.141443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.141901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.142327 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.371265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c375a801-702c-41d3-8546-9352f517d7fc", "tag": "f5092e9b-ed55-405f-a0f7-2c55deb94a67"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:41:59.386828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.387710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.388301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.400841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] Creating event network-changed:f5092e9b-ed55-405f-a0f7-2c55deb94a67 for instance c375a801-702c-41d3-8546-9352f517d7fc on hv-cinder-78102 Aug 10 08:41:59.406280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-b8cb9b09-971e-4683-bac3-16d352da3697 req-a718be6b-9898-424f-bc8c-6add96c098ed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153091 Aug 10 08:41:59.407410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 23/43] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:41:59.413524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:59.414215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:59.421171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.421658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.422188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.422808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.423443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.423955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.450955 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.469364 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-27be7153-fa8b-40af-961b-10da15733270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.341723 Aug 10 08:41:59.470939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 21/44] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:59 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:59.476714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:59.477312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:59.483572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.484190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.485866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.486691 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.487155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.488142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.645901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.662059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5342abed-edef-44cb-b27d-13401a6da91f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.245519 Aug 10 08:41:59.677549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 24/45] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:59 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:59.677549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:41:59.677549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:41:59.687051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.687543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.687980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.688718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:41:59.689169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:41:59.689584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:41:59.701821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.712180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-029db142-2431-49da-9a17-ee592072dc26 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.240005 Aug 10 08:41:59.725485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 22/46] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:41:59 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:41:59.768485 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.778304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.780104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:41:59.786567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ea2de175-c21a-4a27-89a0-4257b41406a2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.116536 Aug 10 08:41:59.786567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 25/47] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:41:59 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:00.495846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:00.501604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:00.503543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.504802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.505264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.505969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.506633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.510960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.686447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:00.687204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:00.693277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.693988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.694431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.695169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.695627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.695877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:00.696054 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.704337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6ccfef11-9545-4bb3-ae1b-f2bfe764c4d2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.217129 Aug 10 08:42:00.718931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:00 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:00.733250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:00.734441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:00.741406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.741816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.742255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.743000 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:00.743469 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:00.743899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:00.863077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=8 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:00.998812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:01.015820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3fbb7aca-4adb-4d14-9aa7-c1d921aa33a1 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.285908 Aug 10 08:42:01.019392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 24/49] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:00 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:01.022558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:01.026167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:01.051269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:01.051269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:01.051269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:01.051269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:01.051835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:01.051835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:01.068425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:01.076314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8b25f60a-85bf-4c5a-b98d-269df63a527e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.393541 Aug 10 08:42:01.077870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 26/50] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:00 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:01.142519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:01.153502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:01.155267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:01.156495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-68776759-e6bd-47c4-b491-c09ed19869b4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.138587 Aug 10 08:42:01.166600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:01 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:01.736634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:01.736634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:01.738326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:01.740717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:01.741267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:01.742098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:01.742682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:01.743174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.012034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.012034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c7e3fcd9-a8a8-43f5-aaae-e5e8c9fe3a01 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.237812 Aug 10 08:42:02.012034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 27/52] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:01 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:02.039819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:02.040692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:02.047440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.048019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.048662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.049613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.050224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.050877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.098157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:02.098891 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:02.110268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.111185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.111841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.112763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.113417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.114039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.249332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.257280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3b0d4b79-8701-4264-bb93-90506351465d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.221840 Aug 10 08:42:02.258100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 26/53] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:02 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:02.262946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:02.263819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:02.269948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.270683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.271367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.272248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:02.272709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:02.273135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:02.302693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.315217 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-87e9dbe4-7888-442f-8807-dd815a4b90b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.221086 Aug 10 08:42:02.315860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 28/54] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:02 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:02.354834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.363439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.365042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:02.366228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-483345d5-5981-48d3-997d-6c21e2e452b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.106993 Aug 10 08:42:02.366839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 27/55] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:02 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:03.003929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:03.004942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:03.015654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.016392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.017170 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.019223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.019849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.027260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.027260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:03.282696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.282696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0b5a792b-0802-4c0a-a361-9cb7a7ea83ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.278151 Aug 10 08:42:03.282696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 29/56] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:02 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:03.283003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:03.283549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:03.290158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.291133 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.292076 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.292969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.293438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.293871 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.298374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:03.337411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:03.338355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:03.345165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.345711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.346149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.346955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.347433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.347853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.471319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.479349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d69663f9-9cf1-4d49-8578-29facc767595 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.202892 Aug 10 08:42:03.480017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 28/57] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:03 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:03.484582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:03.485502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:03.492101 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.492653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.493151 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.494009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:03.494482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:03.494918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:03.504099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.516934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ae82eb98-fdb2-43cd-bee9-e87a9734b28b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.183501 Aug 10 08:42:03.517834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 30/58] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:03 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:03.597132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.608206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.610447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:03.612787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2dc64604-d431-44b7-a240-e9c068bf2385 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.131153 Aug 10 08:42:03.613949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 29/59] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:03 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:04.300275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:04.301022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:04.308140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.308623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.309060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.309752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.310202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.310651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.448341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.455926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6a9c1448-b6d5-4231-bfd9-85025af9f724 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.160720 Aug 10 08:42:04.456544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 31/60] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:04 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:04.502587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:04.503300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:04.511702 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.532200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.532200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.532200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.532200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.532864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.538195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:04.538815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:04.542710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:04.555511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.556036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.557648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.558381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.558865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.559317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.773766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.782968 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-28755c0d-d810-4534-8f12-60efd8c85bcf tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.285044 Aug 10 08:42:04.783554 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 30/61] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:04 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:04.792511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:04.793123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:04.804441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.804934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.805383 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.806064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:04.806538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:04.807260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:04.873758 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.884362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-962f4d71-848d-45f0-b484-518bb9d92b5e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.350630 Aug 10 08:42:04.885585 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 32/62] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:04 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:04.920881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.932497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.934450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:04.936411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ff9d3b31-041f-431d-83d2-d61bdef72767 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.148437 Aug 10 08:42:04.937156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 31/63] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:04 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:05.478627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:05.479663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:05.489300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.489871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.490401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.491336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.491794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.492216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.632237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:05.639939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-45f1c351-bc4b-4869-9ec5-5d479091011a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.166413 Aug 10 08:42:05.649412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:05 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:05.804990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:05.805626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:05.814913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.821470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.821470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.821470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.821470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.822020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.913544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:05.915588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:05.916517 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=4 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:05.928068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.929659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.931150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.931953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:05.933793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:05.934780 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:05.967284 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=32 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:06.012551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.020340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-380aeb20-f678-4056-bce3-93a0dea306e5 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.219216 Aug 10 08:42:06.024514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:05 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:06.039747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:06.040601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:06.050431 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:06.053340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:06.053340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:06.053340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:06.053340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:06.053799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:06.095142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.103423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-16981974-40a8-4614-9e14-d074c7acc846 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.194776 Aug 10 08:42:06.104212 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 34/66] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:05 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:06.151485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.163795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.165429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.166578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ea0767f3-e4a3-4d64-928c-13242574e051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1286 microversion: 2.20 time: 0.143318 Aug 10 08:42:06.167131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:06 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:06.663203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:06.663815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:06.671459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:06.671954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:06.672393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:06.673094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:06.673552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:06.673981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:06.866923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:06.872099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1e276292-1132-44a8-8240-fa70c8971fe3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.212914 Aug 10 08:42:06.875731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 35/68] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:06 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:07.060315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:07.061253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:07.079931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.080674 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.081197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.082162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.082816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.084496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.124579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:07.125333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:07.133304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.137286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.137286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.137286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.137286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.137623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.423307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=22 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:07.442455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:07.449781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b4e09c43-f3fe-4d52-a6ec-57ac1769b23d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.329607 Aug 10 08:42:07.450358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 36/69] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:07 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:07.462786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:07.464798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:07.478172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.478925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.480147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.481115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.481840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.482308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.554819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:07.564265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-47d3c013-424c-425b-946d-e7e2f194e306 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.508027 Aug 10 08:42:07.565699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:07 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:07.566534 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:07.574890 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:07.576610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:07.578165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e09c9176-8207-4183-ae84-7e430a53ee05 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1278 microversion: 2.20 time: 0.123933 Aug 10 08:42:07.579255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 37/71] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:07 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:07.901682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:07.902601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:07.911054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.913821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.913821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:07.915268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:07.916166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:07.916932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.235568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.247166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b95fb0aa-54fe-4738-9f7e-5fee8c3d0065 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.350964 Aug 10 08:42:08.248658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:07 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:08.470902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:08.471826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:08.479102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.479594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.480030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.480742 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.481466 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.482131 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.595707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:08.595707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:08.602439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.602916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.603363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.604077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.608369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.608891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.637196 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.644871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fd3e84dd-ae22-44cc-96db-aae1e0d33fb5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.177978 Aug 10 08:42:08.645466 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 38/73] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:08 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:08.652265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:08.653143 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:08.664102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.664595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.665027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.667182 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.667769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.668536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.741029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.752825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.754735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.756664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-275f6a25-5d72-4567-aaf2-1e5d4520e9bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1278 microversion: 2.20 time: 0.109168 Aug 10 08:42:08.757471 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 39/74] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:08 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:08.787444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd54a38-d75c-4105-80d5-02e459816b82", "tag": "6a2c4332-79ff-43b9-a9bc-89a58d83b87e"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:08.812776 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:08.813147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:08.813862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:08.833985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] Creating event network-changed:6a2c4332-79ff-43b9-a9bc-89a58d83b87e for instance ecd54a38-d75c-4105-80d5-02e459816b82 on hv-cinder-78102 Aug 10 08:42:08.837046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:08.842185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-3c50320d-1f27-40ed-95b2-9668947fcbfb req-bb9422b9-1125-433e-9888-00415e17a39b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065307 Aug 10 08:42:08.843156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 40/75] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:08.846838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a51d663c-af4a-4516-9e0b-ce787a4df967 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.260708 Aug 10 08:42:08.847919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 36/76] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:08 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:09.278319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:09.281391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:09.294225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.297013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.297527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.298299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.298897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.299318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.463630 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:09.471478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-aaa88a73-5827-4af0-a336-7208fdd0e86a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.204973 Aug 10 08:42:09.473715 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 41/77] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:09 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:09.665396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:09.666148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:09.672314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.673043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.673650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.674541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.677549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.677549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.788411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:09.789339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:09.798829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.811350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.811350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.811350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.811350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.811834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.858187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:09.868484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-318b4031-aa73-45aa-82e7-1df72604e301 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.206870 Aug 10 08:42:09.869256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 37/78] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:09 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:09.874981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:09.875965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:09.907182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.908550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.910731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.911652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:09.912259 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:09.913018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:09.965951 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:09.991074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:09.992670 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:09.993810 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5d6d1b5f-1534-4522-a29d-7723ec0a0b00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1278 microversion: 2.20 time: 0.216598 Aug 10 08:42:09.994722 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 42/79] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:09 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:10.290204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:10.295412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-69db7052-755f-4013-9d98-fd8dc0348b2a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.424923 Aug 10 08:42:10.296154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 38/80] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:09 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:10.506476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:10.508055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:10.521159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:10.521159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:10.521159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:10.521632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:10.522152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:10.522816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:10.743902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:10.751882 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-48a0ec46-a048-41ba-856b-d9b091ba69ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.263402 Aug 10 08:42:10.765860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 43/81] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:10 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:10.890788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:10.892141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:10.899769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:10.900280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:10.900689 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:10.901392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:10.901874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:10.902494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.017146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:11.018056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:11.032255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.032762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.033216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.034450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.035108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.035804 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.235744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.271123 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.275546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.275546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-683818cc-544b-401b-977f-167d4b298d7c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1342 microversion: 2.20 time: 0.261213 Aug 10 08:42:11.279577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 44/82] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:11 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:11.285842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e85da63-17bd-4d1c-92c4-e12595e0b6da", "tag": "7431278b-00fa-422a-a466-7dead1e1d119"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:11.326194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.326932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.330263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.363561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] Creating event network-changed:7431278b-00fa-422a-a466-7dead1e1d119 for instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da on hv-cinder-78102 Aug 10 08:42:11.377058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-b0296266-e7e1-464c-b0db-511b67bfccb1 req-cbe45428-7d86-4b2e-b391-1bccfc1a7eca service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095742 Aug 10 08:42:11.377984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 45/83] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:11.391950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:11.392979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:11.401046 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.401805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.402513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.403428 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.404300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.405100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.405716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.416831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-adf6710b-89bd-4331-8a4f-73b693022882 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.531399 Aug 10 08:42:11.417414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 39/84] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:10 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:11.683897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.694545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-777ae707-831c-4000-8b90-c7f83b3eabb4 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.311288 Aug 10 08:42:11.706529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 46/85] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:11 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:11.776925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:11.777600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:11.792408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.792900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.793579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.794327 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:11.794816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:11.795471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:11.979806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:11.994382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3090d501-aefc-4f8d-9681-f95e5bd1aeda tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.220537 Aug 10 08:42:11.994382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 40/86] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:11 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:12.301190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:12.301838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:12.312600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.313128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.314702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.315465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.315931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.316363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.321514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:12.437672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:12.438455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:12.448221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.449847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.450556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.451990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.453164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.453904 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.535940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:12.550455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:12.553521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:12.554952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-07c6dff7-0681-4445-9fac-b96022425a5c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.257544 Aug 10 08:42:12.559722 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 47/87] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:12 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:12.689414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:12.698849 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2c19f75f-362f-443f-a61a-ece18d831efb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.265113 Aug 10 08:42:12.699616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 41/88] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:12 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:12.722628 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:12.723225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:12.729491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.730295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.731233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.732090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:12.732551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:12.732984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:12.875309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:12.883547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-41d1e5ae-7524-4bd2-aa45-423bbd698b35 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.165389 Aug 10 08:42:12.886736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 48/89] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:12 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:13.012817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:13.013496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:13.019892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.020396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.020826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.021519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.021973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.022397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.164241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:13.172582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5dbf700f-62cf-437b-8c67-1dc0d687ae7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.163493 Aug 10 08:42:13.173538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 42/90] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:13 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:13.581800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:13.582407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:13.588876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.589350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.589779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.590569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.591028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.591449 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.719573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:13.720140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:13.720760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:13.727260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.727743 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.728044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:13.728530 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.728852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.729306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.729558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:13.729724 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.730865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ba8965a4-01b7-4a11-a8c6-a3f92e7bc4d0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.153382 Aug 10 08:42:13.742876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 49/91] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:13 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:13.857484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:13.864848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-31331ea3-e322-497d-ac95-80edebe62152 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.148885 Aug 10 08:42:13.865414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 43/92] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:13 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:13.905611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:13.906209 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:13.913544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.914029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.914481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:13.915192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:13.915615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:13.916035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.166812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:14.176137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cb9644ec-3308-4dd1-941c-3258921caada tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.274894 Aug 10 08:42:14.179090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 50/93] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:13 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:14.194253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:14.199512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:14.201682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.202601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.204623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.206213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.206901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.207579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.369945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:14.374083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:14.379019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1b1b7357-b2fb-4344-8433-37158c577d64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.189789 Aug 10 08:42:14.379695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 44/94] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:14 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:14.759841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:14.760440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:14.768354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.769071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.769681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.772875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.772875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.772875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.885396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:14.887664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:14.896438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.901638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.902298 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:14.916684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:14.922009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:14.922009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.060018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.068602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.070139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.071384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ef98a3aa-7e52-4bad-abf4-aadfbce928dc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.315381 Aug 10 08:42:15.072743 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 51/95] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:14 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:15.117185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.125619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8e65466d-4009-4feb-8617-9cdc7f2c44b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.244197 Aug 10 08:42:15.126175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 45/96] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:14 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:15.155061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c79780-62f6-4085-9cd0-30550cf68695", "name": "network-vif-plugged", "status": "completed", "tag": "acc60288-26b4-4b95-b6ab-83d4f33a680e"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:15.165353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.165766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.166198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.178128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] Creating event network-vif-plugged:acc60288-26b4-4b95-b6ab-83d4f33a680e for instance d1c79780-62f6-4085-9cd0-30550cf68695 on hv-cinder-78102 Aug 10 08:42:15.183320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-b82e7ad3-31ed-4a52-8db0-27caca0ac04e req-b95fd0cd-6bb1-4b06-beb4-52b8dc53eb95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109339 Aug 10 08:42:15.183927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 52/97] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:15.203182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:15.203182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:15.209822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.210398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.210924 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.211837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.212494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.213001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.231075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:15.244161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.244698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.245304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.259559 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] Creating event network-changed:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:42:15.265176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-66c2f59b-9f41-49f5-a1ad-6e51a654f7c4 req-e88985e1-9de8-450b-b0da-67eada72d35c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041465 Aug 10 08:42:15.266041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 53/98] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:15.400478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:15.401299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:15.407643 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.408135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.409122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.409821 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:15.410557 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:15.410988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:15.424033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.432904 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2229606a-5280-4005-a1b5-1fbe13a46130 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.235974 Aug 10 08:42:15.433547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 46/99] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:15 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:15.547373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:15.555395 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-69af865f-c861-4a71-a62c-e122106d4d10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.159283 Aug 10 08:42:15.555952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 54/100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:15 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:16.109795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:16.110399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:16.118973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.119428 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.119858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.120557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.121013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.121465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.147287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:16.147888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:16.163838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.164332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.164763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.165453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.165902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.166320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.448981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.457737 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-dcd264c3-3ca2-4fdf-a834-971946d1bfce tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.314524 Aug 10 08:42:16.459304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 55/101] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:16 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:16.467331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:16.468207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:16.476197 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.477343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.478347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.479887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.480558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.481884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.692505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.709659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8a3b41a3-c122-4d58-8202-d0e851166e2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.248834 Aug 10 08:42:16.711207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 56/102] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:16 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:16.716020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:16.716615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:16.723319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.724004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.724888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.725523 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:16.726114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:16.726716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:16.768977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.779573 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.781444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.782728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-03c23598-a28f-4c4d-ad1e-4b3cc890e348 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.677071 Aug 10 08:42:16.783286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 47/103] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:16 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:16.891514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:16.900403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0cc3247e-b674-4b2f-a2c7-933dcac25dd3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.187961 Aug 10 08:42:16.910442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 57/104] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:16 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:17.478948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:17.479560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:17.485583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.486064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.487111 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.487810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.488263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.488685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.633113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:17.655390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4368a415-45a9-4f9f-ae1b-b022d48a64b0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.179232 Aug 10 08:42:17.656030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 48/105] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:17 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:17.734441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:17.735330 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:17.745043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.745043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.745043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.745043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.745522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.745522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.806650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:17.807869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:17.814925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.815625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.816374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.817242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.817850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.818492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.901826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:17.909695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d4286bb3-657b-4d79-984c-440613c6169d tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.179101 Aug 10 08:42:17.910618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 58/106] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:17 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:17.927613 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:17.928456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:17.935104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.935588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.936017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.936822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:17.937273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:17.937690 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:17.967850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:17.976613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:17.978125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:17.979275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3f2494fa-30ba-4ed7-a397-9522cb22aea3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.176876 Aug 10 08:42:17.980003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 49/107] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:17 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:18.075341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:18.083056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a4ed0a18-57c4-4143-8d67-f615558e1067 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.160959 Aug 10 08:42:18.083621 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 59/108] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:17 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:18.677412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:18.678366 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:18.684678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:18.685269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:18.685717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:18.686411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:18.686918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:18.687453 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:18.838124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:18.839546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-184645b2-2ba9-44f5-b984-1d9e72122cf5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.166596 Aug 10 08:42:18.840120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 50/109] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:18 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:18.929783 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:18.930458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:18.936609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:18.937079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:18.937518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:18.938290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:18.938771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:18.939478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.002564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:19.003280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:19.009208 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.009682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.010110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.010850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.011458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.012021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.073999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:19.082403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-732211f2-f694-414a-8d72-4b3b3189f962 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.156361 Aug 10 08:42:19.083002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 60/110] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:18 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:19.105581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:19.106725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:19.114816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.115579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.116453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.117222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.117686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.118112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.150985 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:19.160226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:19.161738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:19.162874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-79c6dab6-af33-4d6e-ace7-4c95c2b81a9a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.164518 Aug 10 08:42:19.163441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 51/111] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:18 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:19.250761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:19.258167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f39f2665-65a0-4556-9679-0dcc8e29a818 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.157429 Aug 10 08:42:19.258764 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 61/112] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:19 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:19.860651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:19.861261 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:19.867574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.868062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.868496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:19.869255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:19.869712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:19.870130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.024080 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.032362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-82e71005-1e01-4e52-9648-80d23cf10dfa tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.175534 Aug 10 08:42:20.032942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 52/113] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:19 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:20.105893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:20.107327 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:20.115018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.116022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.116636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.117579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.118269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.118910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.185289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:20.187407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:20.196071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.204402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.210282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.210282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.210282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.210282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.446294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.454413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0af6b44d-3073-483d-8499-c1cbd9f70969 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.353628 Aug 10 08:42:20.455984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 62/114] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:20 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:20.465877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:20.480257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:20.489239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.489924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.490358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.491126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:20.491576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:20.491992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:20.617451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.625911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.633515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.634934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b05c13bb-17bd-4a75-a719-2f28450f4ab1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.453528 Aug 10 08:42:20.637526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 53/115] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:20 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:20.785171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:20.792848 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bbab1a13-ba3a-4324-adfa-b3f0d455afee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.334948 Aug 10 08:42:20.793411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 63/116] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:20 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:21.055422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:21.056013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:21.062168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.062689 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.063278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.063971 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.065223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.065653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.204622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.212882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2ed08271-8a44-435d-979c-153d62168bf0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.161695 Aug 10 08:42:21.213488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 54/117] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:21 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:21.477510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:21.478112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:21.484438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.484932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.485380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.491049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.491049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.491049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.618860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.626173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3b1f2186-7ba5-4e6a-bdf6-001943e5e24a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.152807 Aug 10 08:42:21.626766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 64/118] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:21 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:21.657886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:21.659047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:21.665128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.665607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.666416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.667128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.667579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.668001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.819249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.826984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:21.827588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:21.832397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.833906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.835050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-11324526-a8b0-467a-8718-1617d9e42a98 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.181095 Aug 10 08:42:21.837685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 55/119] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:21 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:21.839250 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.843731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.843731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.843731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:21.843731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:21.844766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:21.848098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:21.978500 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:21.985990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f46a6758-d07b-448f-b4d0-0045055e0839 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.176496 Aug 10 08:42:21.987340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 65/120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:21 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:22.233742 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:22.234353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:22.241027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.241526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.242030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.242761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.243219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.243646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.372073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:22.379673 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-49e1e533-45c0-4c0c-bd13-962124be8d0f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.149979 Aug 10 08:42:22.380251 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 56/121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:22 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:22.647443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:22.648004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:22.654193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.654711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.661524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.670274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.670791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.671447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.820938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:22.828599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c022fca2-2465-4652-9269-3bf19fe7e86b tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.186149 Aug 10 08:42:22.829173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 66/122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:22 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:22.867212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:22.870979 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:22.883009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.891049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.891049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.891049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.891049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.891379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.922228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375a801-702c-41d3-8546-9352f517d7fc", "name": "network-vif-plugged", "status": "completed", "tag": "f5092e9b-ed55-405f-a0f7-2c55deb94a67"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:22.943277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:22.943759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:22.944191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:22.959424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] Creating event network-vif-plugged:f5092e9b-ed55-405f-a0f7-2c55deb94a67 for instance c375a801-702c-41d3-8546-9352f517d7fc on hv-cinder-78102 Aug 10 08:42:22.965729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-29479f55-1528-4946-8562-3254d2ce2b8c req-94a66d3e-7b1b-4eef-b0f0-8c82b951b274 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046957 Aug 10 08:42:22.965729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 67/123] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:23.009377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:23.010183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:23.018481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.019311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.020090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:23.020849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.021498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.021968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:23.058239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:23.070032 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:23.071753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:23.073242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fb0ecbb8-eab8-404c-b4a8-7de546d08bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.210191 Aug 10 08:42:23.074911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 57/124] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:22 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:23.231277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:23.239867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-85e8bf39-e675-4bba-ac65-d23664e2c84f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.235273 Aug 10 08:42:23.240527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 68/125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:23 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:23.401492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:23.402162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:23.408812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.409296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.409974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:23.410708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.411165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.411584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:23.602570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:23.610574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-500ce771-311e-4b86-9f06-668d5b35ba57 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.213528 Aug 10 08:42:23.611165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 58/126] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:23 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:23.849626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:23.850226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:23.859275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.859801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.860382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:23.862286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:23.862957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:23.863572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.105327 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:24.105927 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:24.115373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.117728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.118791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.119602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.120432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.121187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.123381 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.129479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-18d35aa4-9d61-427f-a4f0-62c058f6208a tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.282072 Aug 10 08:42:24.129479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 69/127] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:23 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:24.261981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:24.262747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:24.272612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.275435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.276400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.277424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.278073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.278969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.406055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.422802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.424487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.425655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b0eed05c-046c-48af-a2a5-1acf6ac7eaf8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.324224 Aug 10 08:42:24.426269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 59/128] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:24 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:24.492172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.499567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f5347063-0e0f-47b0-a76b-6348f1600b78 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.241970 Aug 10 08:42:24.500132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 70/129] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:24 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:24.631201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:24.631838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:24.637682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.638229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.638704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.639387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.639920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.640342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:24.979368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e85da63-17bd-4d1c-92c4-e12595e0b6da", "name": "network-vif-plugged", "status": "completed", "tag": "7431278b-00fa-422a-a466-7dead1e1d119"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:24.993695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:24.998266 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:24.998688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:24.999122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.004001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-da2f7e9b-d375-42aa-b366-8f41aa307df2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.377146 Aug 10 08:42:25.004977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 60/130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:24 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:25.011950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] Creating event network-vif-plugged:7431278b-00fa-422a-a466-7dead1e1d119 for instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da on hv-cinder-78102 Aug 10 08:42:25.017968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-2e774f5e-8167-4c22-8c72-9c81bef5f64c req-054e4141-baf0-402f-8f69-6e7063f47d48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042461 Aug 10 08:42:25.018618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 71/131] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:42:25.155707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:25.156828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:25.168869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.169364 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.169796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.170499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.171137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.171559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.190515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:25.329303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:25.336812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-59cc5b5c-338d-4fc2-917f-9bf81b651bed tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1315 microversion: 2.1 time: 0.185017 Aug 10 08:42:25.337385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 61/132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:25 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:25.452927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:25.453639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:25.459818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.460298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.460729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.461405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.461854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.462271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.523070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:25.523974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:25.530254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.530978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.531572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.532321 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:25.533595 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:25.534022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:25.616474 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:25.628579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:25.647673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:25.648753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6ae7103c-7cb2-498c-b820-33dacef83a07 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.200357 Aug 10 08:42:25.649837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 72/133] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:25 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:25.691855 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:25.700667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-58ca15d8-a4c8-448d-b353-ad57f30b4b0b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.182268 Aug 10 08:42:25.701239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 62/134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:25 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:26.024857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:26.026054 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:26.035322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.038420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.040183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.042022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.043000 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.045162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.241016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.261872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e0ed8c2f-06fa-4c33-a806-ce33c11745bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.240692 Aug 10 08:42:26.262586 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 73/135] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:26 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:26.358862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:26.359436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:26.370763 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.371929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.373472 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.374690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.378172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.378726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.570396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.581351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1d5fbabd-1a7b-4a9d-bca7-b4b3783f49b8 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1502 microversion: 2.1 time: 0.226880 Aug 10 08:42:26.583078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 63/136] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:26 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:26.675645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:26.676699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:26.687974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.691489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.691489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.691489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.692170 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.694415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.722490 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:26.723275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:26.733169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.736071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.738227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.739439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:26.741506 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:26.742131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:26.906562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.915051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-29146b35-3deb-4fdb-8fee-8eafe90d6b42 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.196658 Aug 10 08:42:26.915627 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:26 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:26.966069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.974039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.975561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:26.976658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9cae3287-2901-4336-a766-37c38fe99f6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.306963 Aug 10 08:42:26.977219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 74/138] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:26 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:27.031653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd54a38-d75c-4105-80d5-02e459816b82", "name": "network-vif-plugged", "status": "completed", "tag": "6a2c4332-79ff-43b9-a9bc-89a58d83b87e"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:27.045699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.046177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.046706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.077707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Creating event network-vif-plugged:6a2c4332-79ff-43b9-a9bc-89a58d83b87e for instance ecd54a38-d75c-4105-80d5-02e459816b82 on hv-cinder-78102 Aug 10 08:42:27.078501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 08:42:27.079081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-fc1233e2-daf2-485a-aed5-8a7eabb7ec9b req-e788e762-af92-4c68-9fbd-2cd2f9c9a76c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 08:42:27.080526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.081371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.082116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.083253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.084317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.084995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.099074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.compute.rpcapi [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 08:42:27.099074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] Releasing lock "compute-rpcapi-router" {{(pid=124810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 08:42:27.127863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a86ef828-7703-4b89-b4ce-713c7bea1b3c None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094542 Aug 10 08:42:27.127863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 65/139] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:27.283823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:27.287029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:27.290960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.291491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.291928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.292664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.293109 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.293529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.441320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:27.449253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-df1c7a87-1754-4e70-a62a-7e7195612169 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.169456 Aug 10 08:42:27.450050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 75/140] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:27 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:27.936667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:27.937440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:27.944383 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.944964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.945486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:27.946243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:27.946780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:27.947270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:28.008254 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:28.008254 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:28.023131 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:28.023626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:28.026191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:28.028247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:28.030176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:28.030952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:28.147511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:28.155107 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fc181d6c-caf9-4cc0-8e1f-41aab984e7ee tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.222674 Aug 10 08:42:28.155710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 66/141] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:27 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:28.208256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:28.217452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:28.218969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:28.220299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cf70f756-4a87-4a2b-b6fd-25ae10414f50 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.224783 Aug 10 08:42:28.221223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 76/142] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:27 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:28.470093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:28.470822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:28.477548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:28.478030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:28.478486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:28.479192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:28.479769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:28.480189 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:28.608633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:28.616942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d6019a9b-7a3a-4b29-b0ac-fcdcc7f4a97e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.150579 Aug 10 08:42:28.617730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 67/143] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:28 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:29.179356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:29.179967 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:29.190489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.195063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.195885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.196843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.197522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.198051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.248928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:29.251121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:29.263318 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.265197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.266017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.268839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.269574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.272756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.484595 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:29.494582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:29.496351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:29.497638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b167106c-963d-467e-8b6e-81b8e1d2951f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.254804 Aug 10 08:42:29.498198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 68/144] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:29 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:29.638880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:29.639808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:29.646187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:29.646642 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.648954 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.649588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.650578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.651152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.651578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.653630 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-169b74e0-3da1-4986-93dd-044744020baf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.480200 Aug 10 08:42:29.661620 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 77/145] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:29 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:29.751796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7551af0b-3de6-490a-b2c7-4dda8b5907fd"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:29.754918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:29.769647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.770211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.770896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.771615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:29.772511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:29.772946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:29.839870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:29.852827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-56e4701a-e6ab-430c-a86a-d9af2442ad56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.216404 Aug 10 08:42:29.855783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 69/146] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:29 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:30.255734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "name": "network-vif-plugged", "status": "completed", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:30.261069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:30.266170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.266687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.267116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.278582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] Creating event network-vif-plugged:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:42:30.284373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-2690db9d-352c-42f5-98f2-0ec498592f6c req-8c5b0d92-3e0e-4a44-b24a-0cb84947d6fa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032056 Aug 10 08:42:30.285072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 70/147] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:42:30.522033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:30.523019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:30.529480 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.530042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.530648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.531403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.531994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.532482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.671181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:30.679997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:30.681564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:30.682719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e93c38a1-3e20-46df-9d87-d059c92fc356 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.164956 Aug 10 08:42:30.683283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 71/148] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:30 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:30.687633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:30.688237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:30.694148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.694677 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.695118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.695811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.703712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.703712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.835215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:30.842859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9fc3c172-b0b5-4a79-acb6-47549df14581 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1322 microversion: 2.1 time: 0.158604 Aug 10 08:42:30.843615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 72/149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:30 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:30.877443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:30.878158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:30.884116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.884597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.885250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:30.885960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:30.886399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:30.886895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:31.054998 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:31.067315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8aa9c443-d534-4625-8e37-b03cfb856f4e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.193890 Aug 10 08:42:31.068063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 73/150] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:30 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:31.707150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:31.707817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:31.734499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:31.735005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:31.735452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:31.736253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:31.736711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:31.737137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:31.915775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6f59efcf-7c13-4f64-9c85-2283bdb18de0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "POST /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.170002 Aug 10 08:42:31.918840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 78/151] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:42:29 2022] POST /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695/os-volume_attachments => generated 194 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:42:31.927226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:31.936526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:31.938831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:31.940680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a5b822f1-e437-4b63-b52b-3dfb829113db tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.239430 Aug 10 08:42:31.941696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 74/152] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:31 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:31.949736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:31.950602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:31.968850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:31.969354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:31.969801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:31.970669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:31.971209 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:31.975013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.089104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:32.090155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:32.097037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.097526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.097963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.100392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.100868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.101473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.286415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:32.295694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a0751d73-bc71-42f5-bbd3-a7861c6c20c3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1363 microversion: 2.1 time: 0.209337 Aug 10 08:42:32.295694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 75/153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:32 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:32.311372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:32.318884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-01b6bc45-2293-4f6c-bf7e-92ab79aebd3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1516 microversion: 2.1 time: 0.396812 Aug 10 08:42:32.319413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 79/154] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:31 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:32.342847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:32.350356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:32.357742 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.358543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.359198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.360168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.360858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.362520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.444588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'flavor' on Instance uuid 1e85da63-17bd-4d1c-92c4-e12595e0b6da {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:42:32.859042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5b8554fd-f91c-4415-b4ee-f8f35f0cba03 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da/action" status: 200 len: 32 microversion: 2.1 time: 0.522162 Aug 10 08:42:32.859720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 76/155] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:42:32 2022] POST /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da/action => generated 32 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 08:42:32.874347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:32.875073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:32.881247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.881737 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.882169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.882873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.883326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.883745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.963918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:32.964634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:32.971526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.972099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.972433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.973119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:32.973567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:32.973983 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:32.978047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:33.012901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:33.021144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-efa967be-9859-4c27-b1c3-a78a183af4c2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.150596 Aug 10 08:42:33.021923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 80/156] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:32 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:33.132183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:33.142966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:33.145255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:33.146764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c946a1f0-fbfc-42a2-94ac-a8d1bad1a1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.187082 Aug 10 08:42:33.147396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 77/157] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:32 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:33.315801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:33.316611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:33.323068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:33.323561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:33.323976 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:33.324650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:33.325099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:33.325518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:33.477083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:33.481696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:33.486736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f4de314e-a333-4b6e-a3b4-a6faffb0ffdd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1549 microversion: 2.1 time: 0.174650 Aug 10 08:42:33.487788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 81/158] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:33 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:33.516424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:33.521448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:33.532249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:33.532695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:33.533311 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:33.534163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:33.535041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:33.535612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:33.611751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-10ad6233-02af-4cb0-a530-50a27be0ab0a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101459 Aug 10 08:42:33.612522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 78/159] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:42:33 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:34.042683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:34.043299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:34.046960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:34.051511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:34.052062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:34.052582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:34.053332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:34.053872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:34.054273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:34.169585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:34.170099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:34.179763 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:34.180257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:34.180784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:34.181776 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:34.182514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:34.183126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:34.373805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:34.382237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:34.383873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:34.384989 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3dba50c1-f961-4f3a-935b-482426228b9c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1408 microversion: 2.20 time: 0.219807 Aug 10 08:42:34.385709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 79/160] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:34 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:42:34.405374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:34.419091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8df638cc-1613-4b49-a7c5-eca0ee664151 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.380021 Aug 10 08:42:34.419744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 82/161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:34 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:35.502770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:35.502770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:35.502770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.502770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.504617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.504617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.504617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.504617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.504989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:35.504989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:35.504989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.504989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.505570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.505570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.505570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.505570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.569493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:35.578665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:35.581386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:35.582596 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8555136a-43bf-443a-a031-4ee4d72bbe61 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1598 microversion: 2.20 time: 0.179106 Aug 10 08:42:35.583162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 80/162] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:42:35 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:42:35.610217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:35.618047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:35.618047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.618047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.618395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.619097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.619554 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.619977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.707533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:35.717195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-701fe820-1fb7-4c9f-8b77-fee0e0ba99d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.280765 Aug 10 08:42:35.718090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-52fb0db1-8e7f-4f4d-aa3c-cdc3afa298ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112028 Aug 10 08:42:35.718744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 81/163] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 10 08:42:35 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:42:35.719468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 83/164] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:35 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:35.724833 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd54a38-d75c-4105-80d5-02e459816b82", "tag": "6a2c4332-79ff-43b9-a9bc-89a58d83b87e"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:35.735320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:35.735883 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:35.736313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:35.747386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] Creating event network-changed:6a2c4332-79ff-43b9-a9bc-89a58d83b87e for instance ecd54a38-d75c-4105-80d5-02e459816b82 on hv-cinder-78102 Aug 10 08:42:35.753569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-2c424377-c33e-4b47-b903-6989998edaa4 req-dd4996ac-d710-4355-a09e-bdcd96683ccd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032565 Aug 10 08:42:35.754123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 82/165] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:36.747695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:36.750781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:36.761816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:36.762306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:36.762945 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:36.763834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:36.764470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:36.765055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:36.933657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:36.948936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cc4f51b8-943d-4171-8055-ae4bf8023f7e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.211722 Aug 10 08:42:36.949682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 84/166] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:36 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:37.775041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:37.784079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:37.796591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:37.797482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:37.798609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:37.816331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] Creating event network-changed:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:42:37.822327 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-ca2e9d98-e86e-48fc-950c-27fe686e81e6 req-fc70c7b0-f178-46b8-96e7-61b4772d0c6b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051753 Aug 10 08:42:37.823052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 83/167] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:37.970023 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:37.970692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:37.977303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:37.978231 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:37.983039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:37.983039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:37.983039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:37.983039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:38.385941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:38.396135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8a1c5d6e-4de0-476a-b3a4-16833416127f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.429894 Aug 10 08:42:38.398237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 85/168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:37 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:39.422421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:39.423178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:39.432810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:39.433303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:39.446568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:39.446568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:39.446568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:39.446568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:39.606620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:39.614023 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-60e15dca-373f-4f5d-9a2e-0a7b6f6d3a75 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.200603 Aug 10 08:42:39.614607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 84/169] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:39 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:40.647324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:40.647324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:40.648232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:40.649026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:40.649677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:40.650921 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:40.651380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:40.654148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:40.833642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:40.841582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7395bd26-342f-4b70-a1e7-0e3b1830b213 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.209617 Aug 10 08:42:40.842159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 86/170] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:40 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:41.863402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:41.864154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:41.869901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:41.870406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:41.870868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:41.871546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:41.871991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:41.872435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:42.039960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:42.051499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-571ae828-2aba-4478-a569-22b50d19a5ec tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.192537 Aug 10 08:42:42.065386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 85/171] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:41 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:42.129773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1582594318", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "networks": [{"uuid": "58d64bfe-104b-4d8a-9e62-911ef9e90c3e"}]}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:42.193293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] validate_networks() for [('58d64bfe-104b-4d8a-9e62-911ef9e90c3e', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:42:42.637398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:42:42.637800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:42:42.638265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:42:42.638703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:42:42.639144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:42:42.648130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:42.648607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:42.649032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:42.649740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:42.650193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:42.650794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:42.668052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Getting quotas for project ca3946b4be044dc892d608672069c366. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:42:42.671915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Getting quotas for user 827e8de6dbf84bdd809a359b5bf5a6cf and project ca3946b4be044dc892d608672069c366. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:42:42.683487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:42:42.685699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:42:42.816915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a98ff388-43b1-4506-9a5d-475b0d440062 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691088 Aug 10 08:42:42.823257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 87/172] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:42:42.828640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-69a2f7ec-87df-4b5e-a42d-4c278d14d44c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:42.829808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-69a2f7ec-87df-4b5e-a42d-4c278d14d44c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:42.884875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:42.885647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:42.895784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:42.898247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:42.899581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:42.900546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:42.901344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:42.901951 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:42.914869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-69a2f7ec-87df-4b5e-a42d-4c278d14d44c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:42.933911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-69a2f7ec-87df-4b5e-a42d-4c278d14d44c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1214 microversion: 2.1 time: 0.109233 Aug 10 08:42:42.935420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 86/173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:42 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:42.958409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:42:43.071393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:43.071992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:43.078226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:43.078751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:43.079684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:43.080436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:43.080892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:43.081315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:43.225936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:43.233497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ab25ed97-5256-4ca3-9220-b4111d45c6cd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.165971 Aug 10 08:42:43.234247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 87/174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:43 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:43.280118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8055ae7f-cbc5-4c18-9c89-1b4f921b391f tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 204 len: 0 microversion: 2.1 time: 0.399174 Aug 10 08:42:43.280595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 88/175] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:42:42 2022] DELETE /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:42:43.288648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:43.289541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:43.295459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:43.296052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:43.296583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:43.297409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:43.297994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:43.298521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:43.439395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:43.463058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e8d05d8f-b7cc-43bb-afaa-9e9b1bd76c28 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1554 microversion: 2.1 time: 0.163515 Aug 10 08:42:43.463058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 88/176] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:43 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:43.955876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c880bad7-afbf-4b28-a41f-e1efec2cefb4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:43.957303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c880bad7-afbf-4b28-a41f-e1efec2cefb4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:44.024799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c880bad7-afbf-4b28-a41f-e1efec2cefb4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:44.032656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c880bad7-afbf-4b28-a41f-e1efec2cefb4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1214 microversion: 2.1 time: 0.080996 Aug 10 08:42:44.033244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 89/177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:43 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:44.255482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:44.256978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:44.263078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:44.264024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:44.266130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:44.267944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:44.268410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:44.268834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:44.411925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:44.422841 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6b7f8b8b-04db-4c20-84e8-748349cfa270 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.168731 Aug 10 08:42:44.422841 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 89/178] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:44 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:44.470549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:44.471324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:44.477688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:44.478173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:44.478651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:44.479338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:44.479791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:44.480215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:44.609573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:44.617452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8e443dde-98b9-475c-90da-f02786a16773 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1554 microversion: 2.1 time: 0.151480 Aug 10 08:42:44.618017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 90/179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:44 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:45.053660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:45.054265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:45.060118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.060595 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.061026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.061706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.062156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.062609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.130641 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:45.138122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a5c91746-1d23-4282-bb2a-9e0771ddd72f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1218 microversion: 2.1 time: 0.088274 Aug 10 08:42:45.138724 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 90/180] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:45 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:45.441752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:45.442993 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:45.449746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.450240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.450727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.451425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.451883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.452447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.593930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:45.601918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a06238fe-20d7-47d2-b23b-be9330b1fd27 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.165628 Aug 10 08:42:45.602502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 91/181] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:45 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:45.645445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:45.646188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:45.652612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.653159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.653666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.654432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:45.655045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:45.655647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:45.800526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:45.808993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-df96538a-2607-4bcb-8528-abe617f23a86 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1554 microversion: 2.1 time: 0.167887 Aug 10 08:42:45.809516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 91/182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:45 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:46.160197 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:46.160792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:46.166758 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.167232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.167660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.168329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.168774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.169219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.230091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:46.238292 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fd611b73-21b8-4887-b5c1-ea75a384323b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1266 microversion: 2.1 time: 0.082667 Aug 10 08:42:46.238929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 92/183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:46 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:46.623447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:46.624230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:46.630859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.635132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.635132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.635132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.635132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.635533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.830806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:46.831845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:46.838551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.839125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.839638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.840411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:46.840942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:46.841573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:46.966625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:46.975717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2c6a786c-e4a7-4f7b-b2a2-8b35ca53bec9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.356543 Aug 10 08:42:46.985907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 92/184] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:46 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:47.202451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c79780-62f6-4085-9cd0-30550cf68695", "name": "network-vif-deleted", "tag": "acc60288-26b4-4b95-b6ab-83d4f33a680e"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:47.215115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:47.215604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:47.216036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:47.243533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] Creating event network-vif-deleted:acc60288-26b4-4b95-b6ab-83d4f33a680e for instance d1c79780-62f6-4085-9cd0-30550cf68695 on hv-cinder-78102 Aug 10 08:42:47.256179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-4dabbb6f-0d61-4245-93c6-8cf335e83986 req-015608aa-d2ba-4f6c-a8b4-a11f1272a7b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058124 Aug 10 08:42:47.257062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 93/185] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:47.278010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:47.278869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:47.290579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:47.291126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:47.291736 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:47.293289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:47.293923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:47.294531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:47.378166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:47.393199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ee1c7934-072c-4114-a550-9416ea6b14bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1272 microversion: 2.1 time: 0.134681 Aug 10 08:42:47.394091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 94/186] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:47 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:47.451385 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:47.459900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c85dc130-2b1f-4f5e-b7aa-f8709df6bdc2 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1554 microversion: 2.1 time: 0.633534 Aug 10 08:42:47.460701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 93/187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:46 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1554 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:47.998613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:47.999293 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:48.005492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.006185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.006973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.007732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.008262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.009207 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.154713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:48.164598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d326a1e6-545c-4e75-84b0-df3b55b88c64 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.170760 Aug 10 08:42:48.165741 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 95/188] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:47 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:48.416775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:48.416775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:48.422958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.423513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.423969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.424660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.425127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.425555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.481870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:48.482747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:48.489802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.491663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.492130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.497085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.497706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.498142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.530786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.531274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.531708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.532156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lazy-loading 'fault' on Instance uuid d1c79780-62f6-4085-9cd0-30550cf68695 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:42:48.576166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '527fdf5cf2af40c893b0e4ef9dc4e486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3bd9804f144d64aa4984a3ba0e6e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:48.584937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ef69d451-324f-418a-bb44-433ceaf459e0 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 200 len: 1351 microversion: 2.1 time: 0.107402 Aug 10 08:42:48.585515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 96/189] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:48 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:48.634370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:48.642632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-55491f2d-6288-49fd-bea1-7fd6087e0b7d tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.231377 Aug 10 08:42:48.643215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 94/190] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:48 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:48.792972 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577af2fe-1756-4445-b63a-90d4deee898f", "tag": "6442ce48-0451-40cb-b9fe-a0f2a9f08a30"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:48.802917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:48.803402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:48.803998 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:48.808146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:48.816256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] Creating event network-changed:6442ce48-0451-40cb-b9fe-a0f2a9f08a30 for instance 577af2fe-1756-4445-b63a-90d4deee898f on hv-cinder-78102 Aug 10 08:42:48.825365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-0fae793d-c8af-400e-a706-1d303ffa901d req-84fa15f7-063d-47f9-ad24-d17db270e7ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Aug 10 08:42:48.825365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 97/191] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:49.187082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:49.187685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:49.193637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.194043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.194488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.195190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.195641 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.196063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.401132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:49.409736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ab1cc583-5e1c-41f6-9fb3-5c6b3cac5590 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.226563 Aug 10 08:42:49.410309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 95/192] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:49 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:49.609342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:49.610058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:49.616306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.616818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.617231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.617911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.618401 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.618858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.632907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] HTTP exception thrown: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Request method failure captured: Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 HTTP/1.1 Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829Aj7ffKTfE_DeYXsSSXfr80FBYUzlmPtD7Vz3sqEiw291oLxSAvdx0KZENsiZDokjZ5DU-kpRcFD_nBb1jB0aQ8Z7rfLeA6w3PlK8XL6Ax8QQ486jBPL4vfEVECG2i9oLJHg9uD6_9rNjhXdwRg1vMSJgAZ8HgrwElPij0sCuEIJc Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:42:49.638314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_be3bd9804f144d64aa4984a3ba0e6e2b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 527fdf5cf2af40c893b0e4ef9dc4e486 Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'd1c79780-62f6-4085-9cd0-30550cf68695'} Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:42:49.642818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.644150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.645342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Returning 404 to user: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:42:49.645342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-29d2a649-dc48-4f36-8ab4-873b746cf964 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 404 len: 111 microversion: 2.1 time: 0.035282 Aug 10 08:42:49.645342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 98/193] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:49 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:42:49.664394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:49.665603 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:49.672329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.672845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.673286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.673975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.674732 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.686807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.759236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:49.761609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:49.768618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.769100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.769528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.770224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:49.770692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:49.771108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:49.785303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] HTTP exception thrown: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Request method failure captured: Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695/os-volume_attachments HTTP/1.1 Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829Aj7ffKTfE_DeYXsSSXfr80FBYUzlmPtD7Vz3sqEiw291oLxSAvdx0KZENsiZDokjZ5DU-kpRcFD_nBb1jB0aQ8Z7rfLeA6w3PlK8XL6Ax8QQ486jBPL4vfEVECG2i9oLJHg9uD6_9rNjhXdwRg1vMSJgAZ8HgrwElPij0sCuEIJc Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:42:49.787202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_be3bd9804f144d64aa4984a3ba0e6e2b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 527fdf5cf2af40c893b0e4ef9dc4e486 Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.788421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'server_id': 'd1c79780-62f6-4085-9cd0-30550cf68695'} Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:42:49.789147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:49.790255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:49.796165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Returning 404 to user: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:42:49.796165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7a1aa476-25e7-446e-af30-f80603605540 tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036674 Aug 10 08:42:49.796165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 99/194] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:42:49 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 08:42:49.893199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:49.900944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b1fb42fb-e818-4a27-94f2-3abfc089b0d1 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.240378 Aug 10 08:42:49.901514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 96/195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:49 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:50.431061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:50.432066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:50.439371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:50.440046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:50.440477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:50.441203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:50.441648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:50.442065 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:50.572055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:50.579883 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f6d15e17-b075-4fb0-a235-5f428ff1cf4a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.152738 Aug 10 08:42:50.580436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 100/196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:50 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:50.923302 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:50.923917 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:50.930672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:50.931188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:50.931629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:50.935694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:50.935694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:50.935694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.064898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:51.072625 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3e735e56-5549-43fe-9c0c-d2facba134fd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.153865 Aug 10 08:42:51.073201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 97/197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:50 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:51.202442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:51.202944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:51.209365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.209843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.210275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.210988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.211441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.211862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.225320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] HTTP exception thrown: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Request method failure captured: Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 HTTP/1.1 Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829Aj7ffKTfE_DeYXsSSXfr80FBYUzlmPtD7Vz3sqEiw291oLxSAvdx0KZENsiZDokjZ5DU-kpRcFD_nBb1jB0aQ8Z7rfLeA6w3PlK8XL6Ax8QQ486jBPL4vfEVECG2i9oLJHg9uD6_9rNjhXdwRg1vMSJgAZ8HgrwElPij0sCuEIJc Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:42:51.226864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_be3bd9804f144d64aa4984a3ba0e6e2b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 527fdf5cf2af40c893b0e4ef9dc4e486 Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.228328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'd1c79780-62f6-4085-9cd0-30550cf68695'} Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:42:51.229272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.230648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.232002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Returning 404 to user: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:42:51.232002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1f5c231a-afd9-435f-bb8d-515f035bee2e tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 404 len: 111 microversion: 2.1 time: 0.029581 Aug 10 08:42:51.232002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 101/198] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:42:51 2022] DELETE /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:42:51.237358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:51.237995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] [instance: d1c79780-62f6-4085-9cd0-30550cf68695] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:51.245671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.245671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.245671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.245671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.246020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.246298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.259131 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] HTTP exception thrown: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Request method failure captured: Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 HTTP/1.1 Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829Aj7ffKTfE_DeYXsSSXfr80FBYUzlmPtD7Vz3sqEiw291oLxSAvdx0KZENsiZDokjZ5DU-kpRcFD_nBb1jB0aQ8Z7rfLeA6w3PlK8XL6Ax8QQ486jBPL4vfEVECG2i9oLJHg9uD6_9rNjhXdwRg1vMSJgAZ8HgrwElPij0sCuEIJc Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:42:51.263687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/be3bd9804f144d64aa4984a3ba0e6e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_be3bd9804f144d64aa4984a3ba0e6e2b", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: be3bd9804f144d64aa4984a3ba0e6e2b Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-DeleteServersTestJSON-407497825 Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 527fdf5cf2af40c893b0e4ef9dc4e486 Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-DeleteServersTestJSON-407497825-project Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.265152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'd1c79780-62f6-4085-9cd0-30550cf68695'} Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:42:51.265936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. Aug 10 08:42:51.269592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:42:51.270839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] Returning 404 to user: Instance d1c79780-62f6-4085-9cd0-30550cf68695 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:42:51.270839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-29d492d6-eb9c-4d1b-89a7-8d7b1a4f0c9c tempest-DeleteServersTestJSON-407497825 tempest-DeleteServersTestJSON-407497825-project] 10.222.0.45 "GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695" status: 404 len: 111 microversion: 2.1 time: 0.031568 Aug 10 08:42:51.270839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 98/199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:51 2022] GET /compute/v2.1/servers/d1c79780-62f6-4085-9cd0-30550cf68695 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:42:51.599524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:51.600129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:51.606010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.606520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.606964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.607678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:51.608181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:51.608609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:51.889175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:51.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-41ededf9-89f3-4bd2-b39c-51d5675ec5a5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.301474 Aug 10 08:42:51.897685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 102/200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:51 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:52.094135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:52.095404 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:52.102312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:52.103016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:52.103771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:52.104770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:52.105373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:52.105960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:52.113852 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:52.261556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:52.269372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-48c2aee7-215a-4078-9e76-d4d5cb5fbc19 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.179830 Aug 10 08:42:52.269861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 99/201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:52 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:52.919118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:52.921294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:52.928554 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:52.930222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:52.930901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:52.931769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:52.932374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:52.933047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:52.934185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:53.294934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:53.295754 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:53.309522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:53.318251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:53.318925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:53.319449 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:53.320254 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:53.320805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:53.321320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:53.343602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:53.354641 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8bdd1594-e7c9-45f0-a10d-49febf768095 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.438545 Aug 10 08:42:53.370526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 103/202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:52 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:53.616040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:53.623639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7733373f-692f-476b-8663-fad01ce1fac5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.335886 Aug 10 08:42:53.624675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 100/203] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:53 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:54.381854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:54.382453 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:54.390412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:54.394288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:54.396406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:54.396406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:54.396406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:54.396406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:54.552476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:54.560621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e7ce111f-64e7-4b5a-8b81-bfdde1d9bfac tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.182671 Aug 10 08:42:54.561216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 104/204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:54 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:54.645627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:54.646933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:54.649064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=8 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:42:54.654509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:54.655041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:54.655444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:54.656148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:54.656677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:54.657138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:54.888319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:54.896708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-14ab63a8-7359-49ba-9d37-80aeeea1ba28 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.255503 Aug 10 08:42:54.897293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 101/205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:54 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:55.583656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:55.584953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:55.592914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:55.596969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:55.597594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:55.601329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:55.602051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:55.602693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:55.917473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:55.921790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:55.931158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:55.931892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:55.932389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:55.932957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:55.933306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:55.933990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:55.934669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:55.943141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fc904797-5e58-46e9-8145-1b0f419054e7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.364396 Aug 10 08:42:55.945220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 105/206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:55 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:56.091201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:56.099726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9f8b76dd-0b08-4d95-99fb-ac53a907a668 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.186347 Aug 10 08:42:56.109409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 102/207] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:55 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:56.406180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577af2fe-1756-4445-b63a-90d4deee898f", "name": "network-vif-plugged", "status": "completed", "tag": "6442ce48-0451-40cb-b9fe-a0f2a9f08a30"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:42:56.413987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:56.414612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:56.415326 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:56.427176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] Creating event network-vif-plugged:6442ce48-0451-40cb-b9fe-a0f2a9f08a30 for instance 577af2fe-1756-4445-b63a-90d4deee898f on hv-cinder-78102 Aug 10 08:42:56.432357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-12a5d2b3-9d74-48f1-8f10-2d4763931d81 req-3510f532-9392-4cbf-b034-644c11a54e54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032426 Aug 10 08:42:56.432959 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 106/208] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:42:56.964832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:56.965513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:56.976351 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:56.976841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:56.977322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:56.978161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:56.978654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:56.979078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:57.121624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:57.122350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:57.128878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:57.129372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:57.129838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:57.130569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:57.131027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:57.131451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:57.162355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:57.170316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8defd060-057f-4781-a92e-9b8a56414da8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.209378 Aug 10 08:42:57.178049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 103/209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:56 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:57.268814 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:57.276325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-632f7908-64ff-405a-905d-d95cabacf812 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.158779 Aug 10 08:42:57.277237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 107/210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:57 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:58.191002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:58.191822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:58.200831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:58.201315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:58.201778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:58.202486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:58.202959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:58.203376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:58.296941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:58.298429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:58.304967 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:58.305622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:58.306162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:58.307010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:58.307569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:58.308406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:58.347688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:58.356390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-73ef6501-a91d-4cd4-b5bf-87864f2cc03c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.169032 Aug 10 08:42:58.370370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 104/211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:58 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:58.460604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:58.468525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c7552214-be62-4f3a-a633-8d0469960bf4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.175396 Aug 10 08:42:58.478626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 108/212] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:58 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:42:59.377678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:59.378286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:59.384684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:59.385165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:59.385622 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:59.386306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:59.386800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:59.387224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:59.489555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:42:59.490172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:42:59.496281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:59.496766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:59.497200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:59.497915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:42:59.498373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:42:59.498823 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:42:59.531765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:59.539851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3c7d44f1-d356-4d63-88ef-ad75a771aa49 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.166598 Aug 10 08:42:59.540537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 105/213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:59 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:42:59.634593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:42:59.642071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b7147333-c2b7-4f39-b083-68af0cfc26fe tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.156412 Aug 10 08:42:59.642658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 109/214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:42:59 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:00.566613 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:00.567330 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:00.575289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:00.575777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:00.576221 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:00.577003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:00.577373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:00.577800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:00.665263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:00.666794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:00.684009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:00.684009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:00.684009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:00.684009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:00.684290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:00.684290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:00.924265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:00.936154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2954ceee-2596-49a4-bc35-dabb4fc95e6d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.377244 Aug 10 08:43:00.937091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 106/215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:00 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:00.956422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:00.971647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fa8ce48d-1a7f-470b-839f-c65831540dda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.312169 Aug 10 08:43:00.972220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 110/216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:00 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:01.958076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:01.959554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:01.968399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:01.974865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:01.974865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:01.974865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:01.974865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:01.975366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:01.992505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:01.993229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:02.005328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=86 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:02.013949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:02.015307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:02.016113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:02.017151 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:02.017869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:02.018565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:02.198908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:02.207849 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-314c00e1-a186-41d9-9937-3511b33234a5 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.219920 Aug 10 08:43:02.208705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 111/217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:01 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:02.264173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:02.272171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2d5565dc-6ce8-47cf-ba27-c13464285350 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.318630 Aug 10 08:43:02.273018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 107/218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:01 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:03.231348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:03.232835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:03.240654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:03.241236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:03.241822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:03.242653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:03.243316 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:03.243811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:03.293251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:03.293912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:03.300698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:03.301183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:03.301620 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:03.302431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:03.302937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:03.303583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:03.400288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:03.414248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ecc82f11-6104-43e1-9896-9c6fcae56838 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.187982 Aug 10 08:43:03.418971 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 112/219] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:03 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:03.567577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:03.589802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0c30e612-5844-417b-a0c0-12525b4a6a77 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.300328 Aug 10 08:43:03.590716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 108/220] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:03 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:04.112576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b7873100-236c-42e8-97f6-29b875cfb8d1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: .version_select at 0x7fdef6592ee0>, body: {"keypair": {"name": "tempest-keypair-1712103761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyM6jOxP7lSJHHwQ+/BLX8TSWBsFdMiwATIBn4AW18gLx6m0cD3MeQaQ5aCIf8m4KfUllZcF3EP68ybEyqI8rBtPLXR3q6gOhaDgWAdsjGSvp7V5YfccCYCTP4KiWFdTA=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:04.133563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-b7873100-236c-42e8-97f6-29b875cfb8d1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:43:04.137504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-b7873100-236c-42e8-97f6-29b875cfb8d1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:43:04.238547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b7873100-236c-42e8-97f6-29b875cfb8d1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246059 Aug 10 08:43:04.239203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 113/221] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:43:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:04.435817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:04.436590 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:04.443006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:04.445450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:04.445450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:04.445773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:04.446915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:04.447028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:04.447379 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:04.609672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:04.611671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:04.612441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:04.617626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-11d5ccc4-0af9-4c78-9d89-7d831f18df98 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.186053 Aug 10 08:43:04.618190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 109/222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:04 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:04.618526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:04.619041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:04.620412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:04.620412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:04.620605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:04.621003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:04.759717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:04.769135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b15b2864-540f-40bd-ad1b-9a9522f42e11 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.161428 Aug 10 08:43:04.769966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 114/223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:04 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:05.639646 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:05.640475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:05.646957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:05.647500 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:05.647931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:05.648654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:05.649106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:05.650791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:05.791191 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:05.791803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:05.800009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:05.800827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:05.801574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:05.806487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:05.806487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:05.806487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:05.866291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:05.875198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4fcf2d9a-5572-4e83-949c-a15cdabb59d7 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1314 microversion: 2.1 time: 0.239036 Aug 10 08:43:05.875898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 110/224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:05 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:05.994445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:06.002920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a6bc1ac0-6ea1-48e3-b3b0-198d0a0edfad tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.215538 Aug 10 08:43:06.003624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 115/225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:05 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:06.897311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:06.897926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:06.905325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:06.905805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:06.907545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:06.908515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:06.908967 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:06.909387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:07.027021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:07.027641 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:07.040214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:07.040824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:07.041654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:07.042626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:07.043224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:07.043723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:07.122995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:07.122995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ede18d0e-453d-42d6-8c9b-6bff6cc4ef4e tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1498 microversion: 2.1 time: 0.228081 Aug 10 08:43:07.134343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 111/226] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:06 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:07.282622 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1325916848", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec743362-15f5-4239-ba7d-fe3ce8ba53bc"}], "security_groups": [{"name": "tempest-securitygroup--851844546"}], "key_name": "tempest-keypair-1712103761", "user_data": "}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:07.419987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:07.430258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-457f5501-85f9-4fef-91d2-138c245744e2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.410055 Aug 10 08:43:07.439807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 116/227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:07 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:07.449207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] validate_networks() for [('ec743362-15f5-4239-ba7d-fe3ce8ba53bc', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:43:07.868607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:43:07.869073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:43:07.869582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:43:07.869982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:43:07.870392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:43:07.880340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:07.881161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:07.881592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:07.882536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:07.886955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:07.886955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:07.901999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:43:07.906042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:43:07.918399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:43:07.921361 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:43:08.106938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a1c67690-3ed0-4cc9-b67a-0db67f25335e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.829703 Aug 10 08:43:08.108158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 112/228] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:43:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:43:08.121433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b9cebb56-b170-4b8f-95cb-e7be065e79c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:08.122047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b9cebb56-b170-4b8f-95cb-e7be065e79c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:08.192975 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b9cebb56-b170-4b8f-95cb-e7be065e79c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:08.198839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b9cebb56-b170-4b8f-95cb-e7be065e79c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1242 microversion: 2.1 time: 0.081356 Aug 10 08:43:08.199409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 117/229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:08 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:08.440605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:08.444759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:08.447344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.447902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.448476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:08.449256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.449775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.450269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:08.451269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:08.451932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:08.458528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.459016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.459450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:08.460141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.460620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.461039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:08.479753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:43:08.590795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:08.598726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3356cf41-d084-49cb-b80b-e96540191ff2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.151145 Aug 10 08:43:08.599303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 118/230] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:08 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:08.978855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b310e9ea-71cf-4ce5-98a1-70865d355f38 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "DELETE /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 204 len: 0 microversion: 2.1 time: 0.541776 Aug 10 08:43:08.979457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 113/231] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:43:08 2022] DELETE /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:43:08.987664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:08.988273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:08.994204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.994721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.995148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:08.995848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:08.996295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:08.996712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:09.001105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:09.128119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:09.136089 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8e303b2a-1f1e-4959-99cc-4221ebf4ccf2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1504 microversion: 2.1 time: 0.152305 Aug 10 08:43:09.136774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 119/232] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:08 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:09.221548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9cc9ae4f-9d19-4538-aa5d-63ebb8716fff tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:09.222247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9cc9ae4f-9d19-4538-aa5d-63ebb8716fff tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:09.278125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9cc9ae4f-9d19-4538-aa5d-63ebb8716fff tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:09.285897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9cc9ae4f-9d19-4538-aa5d-63ebb8716fff tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1242 microversion: 2.1 time: 0.068553 Aug 10 08:43:09.286455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 114/233] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:09 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:09.619346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:09.619878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:09.626298 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:09.628862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:09.628862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:09.628862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:09.628862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:09.629220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:09.756003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:09.763658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-16a897da-69f5-4fa3-a21c-0d67815cbecc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.148262 Aug 10 08:43:09.764227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 120/234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:09 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:10.157515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:10.158296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:10.164665 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.165139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.165572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.166249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.166724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.167141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.293671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:10.297740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:10.302251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-99b038be-855d-4226-9aa2-49a4754b76f2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1504 microversion: 2.1 time: 0.149073 Aug 10 08:43:10.302830 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 115/235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:10 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:10.307914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:10.307914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:10.314122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.315237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.315852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.316790 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.317257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.317689 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.378066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:10.385464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-055a902d-b0ff-4096-86a5-2b21d6b1b661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1246 microversion: 2.1 time: 0.082472 Aug 10 08:43:10.386019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 121/236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:10 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:10.785988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:10.786626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:10.792862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.794174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.794174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.794542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:10.794893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:10.795312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:10.923943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:10.931511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4be1da67-f61c-407f-9181-04410f9498c0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.150530 Aug 10 08:43:10.932082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 116/237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:10 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:11.326146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:11.326785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:11.333185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.333669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.334104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:11.334828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.335288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.335715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:11.406993 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:11.407623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:11.414422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.414928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.415354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:11.416036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.416486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.416903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:11.470357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:11.478315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-31c4ce75-03c8-4852-a0be-967cfb8269bd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1504 microversion: 2.1 time: 0.155579 Aug 10 08:43:11.480412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:11.484929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:11 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:11.487757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8f7f32a3-7acc-4fba-b212-d764943a7111 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1246 microversion: 2.1 time: 0.085275 Aug 10 08:43:11.488313 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 117/239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:11 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:11.953670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:11.954371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:11.961886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.962477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.962992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:11.963768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:11.964300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:11.964794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:12.095947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:12.104306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b399b799-0a07-4456-8c72-601de595d30d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1522 microversion: 2.1 time: 0.155406 Aug 10 08:43:12.104879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 123/240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:11 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:12.498375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:12.499029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:12.505431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:12.505909 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:12.506343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:12.507053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:12.507502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:12.507948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:12.508115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:12.508812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:12.514695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:12.515177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:12.515612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:12.516296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:12.516749 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:12.517171 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:12.579748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:12.587414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4ebd9602-6745-4805-9072-b3cefaa32005 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1294 microversion: 2.1 time: 0.083231 Aug 10 08:43:12.588076 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 124/241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:12 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:12.768029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:12.775548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-08a46b0b-3602-4ce2-88e8-b454dc525605 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1504 microversion: 2.1 time: 0.280990 Aug 10 08:43:12.776091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 118/242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:12 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:13.125139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:13.126141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:13.132353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.133345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.133990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.134879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.135919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.138363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.340865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:13.349713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ae3f7b65-78e0-4c3a-9ac3-4a87b5c5abdd tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1502 microversion: 2.1 time: 0.228378 Aug 10 08:43:13.372281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 125/243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:13 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:13.373322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:13.373928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:13.380467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.381150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.381595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.382326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.382811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.383236 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.393162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577af2fe-1756-4445-b63a-90d4deee898f", "name": "network-vif-deleted", "tag": "6442ce48-0451-40cb-b9fe-a0f2a9f08a30"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:13.404965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.406962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.407547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.425081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] Creating event network-vif-deleted:6442ce48-0451-40cb-b9fe-a0f2a9f08a30 for instance 577af2fe-1756-4445-b63a-90d4deee898f on hv-cinder-78102 Aug 10 08:43:13.438270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-8dd80215-dc94-4fee-a0d4-d7d1c5fe2067 req-c711bba6-5c02-4b8f-a454-958f95e15420 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055233 Aug 10 08:43:13.439657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 126/244] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:13.538690 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:13.546211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-75b25943-c2c2-4710-8783-4fce739c25c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1515 microversion: 2.1 time: 0.177917 Aug 10 08:43:13.546884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 119/245] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:13 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:13.612206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:13.614839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:13.624915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.625519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.626024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.626822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.627648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.628684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.702631 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:13.710741 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c7da6c42-1a1a-444f-9d9c-b099274251d6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1312 microversion: 2.1 time: 0.105552 Aug 10 08:43:13.711325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 127/246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:13 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:13.797727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:13.798341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:13.804242 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.805132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.805725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.807084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.807543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.808164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.859033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:13.859601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:13.860110 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:13.860704 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lazy-loading 'fault' on Instance uuid 577af2fe-1756-4445-b63a-90d4deee898f {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:43:13.915141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:13.932139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-263220b2-c7f2-4704-aa88-fed282a805de tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 200 len: 1304 microversion: 2.1 time: 0.138699 Aug 10 08:43:13.932893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 120/247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:13 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:14.732265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:14.733840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:14.740879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:14.741369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:14.741837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:14.743407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:14.743407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:14.743407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:14.918218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:14.933466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cc03a51a-bfae-4c19-8ef5-8cb909228c1b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.205338 Aug 10 08:43:14.934056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 128/248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:14 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:14.956765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:14.957376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: 577af2fe-1756-4445-b63a-90d4deee898f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:14.963829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:14.964312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:14.964750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:14.965439 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:14.966098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:14.966319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:14.979489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] HTTP exception thrown: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Request method failure captured: Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f HTTP/1.1 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829-NG0u6X581HNcHM459lWh2rV9qN9cnhylKrXOhoAuT2Oc6_bAEAbY_Dd74YxsquwuNdeilfopG24iSKCNsjPZ5Gl0CDqYwN6n0q1R8kfi5NZbRqKmNILJezo8TZCl_4aYkcpPqWP03NJw1F58b-9XNBbDowCbrgGhNKh8p3B95qg Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: ca3946b4be044dc892d608672069c366 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:43:14.981115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ca3946b4be044dc892d608672069c366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ca3946b4be044dc892d608672069c366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ca3946b4be044dc892d608672069c366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ca3946b4be044dc892d608672069c366", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: ca3946b4be044dc892d608672069c366 Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesActionsTest-1410640087-project Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 827e8de6dbf84bdd809a359b5bf5a6cf Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesActionsTest-1410640087-project Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. Aug 10 08:43:14.982745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '577af2fe-1756-4445-b63a-90d4deee898f'} Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:43:14.983521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. Aug 10 08:43:14.984947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:14.986128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Returning 404 to user: Instance 577af2fe-1756-4445-b63a-90d4deee898f could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:43:14.986128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cb631d88-9e5f-486c-8cb8-9a8428a35de0 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f" status: 404 len: 111 microversion: 2.1 time: 0.030295 Aug 10 08:43:14.986128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 121/249] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:14 2022] GET /compute/v2.1/servers/577af2fe-1756-4445-b63a-90d4deee898f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:43:15.087011 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-155964137", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "networks": [{"uuid": "58d64bfe-104b-4d8a-9e62-911ef9e90c3e"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:15.142268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] validate_networks() for [('58d64bfe-104b-4d8a-9e62-911ef9e90c3e', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:43:15.347755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db10e43-3a1e-4f21-a834-f8f9e85dbf94", "tag": "ea8c7ee1-cefb-4b08-af72-d8f44ac5497b"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:15.360533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:15.360533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:15.360533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:15.371723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] Creating event network-changed:ea8c7ee1-cefb-4b08-af72-d8f44ac5497b for instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 on hv-cinder-78102 Aug 10 08:43:15.377269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-183f428d-03bc-49ec-9556-4dff06040af1 req-de60ea69-5ffd-43b8-a72e-44e35fcd224d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033038 Aug 10 08:43:15.378128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 122/250] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:43:15.676541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:43:15.676955 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:43:15.677454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:43:15.677857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:43:15.678265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:43:15.688103 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:15.688704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:15.689144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:15.689858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:15.690306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:15.690745 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:15.707517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Getting quotas for project ca3946b4be044dc892d608672069c366. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:43:15.711517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Getting quotas for user 827e8de6dbf84bdd809a359b5bf5a6cf and project ca3946b4be044dc892d608672069c366. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:43:15.724355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:43:15.726621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:43:15.873999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-caf82d90-ca9d-4e6f-8ea0-0447c7b2ceda tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790996 Aug 10 08:43:15.875909 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 129/251] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:43:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:43:15.889725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-98815db4-86f8-4c60-a188-7ff0ae1339da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:15.890914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-98815db4-86f8-4c60-a188-7ff0ae1339da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:15.955427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:15.956040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:15.970310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:15.971498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:15.971498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:15.972017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:15.972470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:15.972889 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:15.985876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-98815db4-86f8-4c60-a188-7ff0ae1339da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:15.997301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-98815db4-86f8-4c60-a188-7ff0ae1339da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1213 microversion: 2.1 time: 0.114383 Aug 10 08:43:15.998365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 123/252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:15 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:16.234662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:16.247957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4e7cba58-0849-4777-aa8c-7f159b1df4d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.296296 Aug 10 08:43:16.248571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 130/253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:15 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:16.594202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:16.596555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:16.603818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:16.606100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:16.606100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:16.606100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:16.606100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:16.606418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:16.629156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'flavor' on Instance uuid c375a801-702c-41d3-8546-9352f517d7fc {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:43:16.915582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-18b72a3d-64a5-4d9f-9fde-87bb016eb5b4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/action" status: 200 len: 32 microversion: 2.1 time: 0.325183 Aug 10 08:43:16.916304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 124/254] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:43:16 2022] POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:43:16.926452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:16.927103 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:16.933009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:16.933490 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:16.933926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:16.934649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:16.935105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:16.935530 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:17.028680 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:17.029488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:17.037362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:17.037894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:17.038438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:17.039265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:17.039829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:17.040476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:17.067990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:17.075425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d478c149-f2bb-4883-a264-02eb8cf28403 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.152852 Aug 10 08:43:17.076404 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 131/255] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:16 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:17.106026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:17.113954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-abcc6bf9-3a96-492a-a7e9-080669e4a283 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1217 microversion: 2.1 time: 0.090206 Aug 10 08:43:17.114542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 125/256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:17 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:17.271186 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:17.299512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:17.299512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:17.299512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:17.299512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:17.299916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:17.299916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:17.299916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:17.425480 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:17.432912 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-89374b1f-86ac-4e31-8862-01e73c20d0c5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.165438 Aug 10 08:43:17.433440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 132/257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:17 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:18.097152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:18.097761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:18.099775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:18.104932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.105412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.109738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.109738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.109738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.109738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.135137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:18.135747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:18.142310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.142829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.143256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.143948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.144401 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.144819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.250969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:18.259177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-36a84dc6-d2f4-4df1-be14-9835068f61a2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.165887 Aug 10 08:43:18.259747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 126/258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:18 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:18.348733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:18.361426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ef3620ae-40ec-4e4a-a956-1298af2abfd4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1217 microversion: 2.1 time: 0.230225 Aug 10 08:43:18.362052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 133/259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:18 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:18.453405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:18.453927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:18.460274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.461039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.461584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.462390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:18.462912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:18.463336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:18.592595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:18.600761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e9c9cf77-a30f-4c31-a1d3-296e3a34c5b7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.151277 Aug 10 08:43:18.601352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 127/260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:18 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:19.280555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:19.281770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:19.287981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.288458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.288889 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.289566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.290068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.290520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.382363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:19.382995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:19.389465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.389958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.390445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.391157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.391608 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.392029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.424653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:19.435396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5b317908-5a74-4d1f-a73f-35d2eadd491e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.158511 Aug 10 08:43:19.435986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 134/261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:19 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:19.457751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:19.465163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5d3cd414-8223-4eb3-b10b-7a14a68b9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1217 microversion: 2.1 time: 0.086922 Aug 10 08:43:19.471035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 128/262] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:19 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:19.621506 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:19.622114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:19.628928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.629422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.629861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.630587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:19.631051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:19.631473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:19.829045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:19.836929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9d402545-f306-44c2-b082-779dbdbf76e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.219604 Aug 10 08:43:19.837598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 135/263] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:19 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:20.457268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:20.457895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:20.464781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.465266 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.465695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.466391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.466869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.467287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.489382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:20.490142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:20.496399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.497072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.497606 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.498433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.498981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.499505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.597288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:20.610858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-52ba97c8-c4f8-4ea7-a106-653a7ef5b55a tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1265 microversion: 2.1 time: 0.125395 Aug 10 08:43:20.611445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 136/264] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:20 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:20.627437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:20.636935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c1ae57d3-f496-4e93-8001-3bee75b66896 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.183819 Aug 10 08:43:20.637452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 129/265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:20 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:20.858594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:20.859208 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:20.865796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.866563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.867014 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.867738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:20.868224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:20.868707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:20.874143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:21.082820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:21.090156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3a083060-258e-43b6-9294-3f0ebbc51c48 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.235498 Aug 10 08:43:21.090788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 137/266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:20 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:21.631953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:21.632701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:21.639446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:21.639961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:21.640477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:21.641763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:21.642240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:21.642945 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:21.658980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:21.660283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:21.667657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:21.670283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:21.670283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:21.670283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:21.671350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:21.671958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:21.711053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:21.718611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d127213f-1e85-4258-af6b-079b65db66e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1271 microversion: 2.1 time: 0.090378 Aug 10 08:43:21.719940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 130/267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:21 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:21.824062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:21.832092 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-696c5c32-d88c-4b4b-bb67-b04b18010967 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.178586 Aug 10 08:43:21.832656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 138/268] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:21 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:22.111103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:22.111652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:22.117763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.118248 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.118728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.119422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.119873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.120293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.252960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:22.260457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-91ffc321-e486-4bd7-bdfa-c3ea527b725a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.153257 Aug 10 08:43:22.261045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 131/269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:22 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:22.741627 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:22.742285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:22.748242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.748724 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.749235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.749917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.750397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.750848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.853460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:22.854071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:22.861146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.861827 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.862444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.863180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:22.863640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:22.864070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:22.877561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:22.882650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:22.885276 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bb734d9a-6d06-45b1-aadb-b97e473c4e67 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.147361 Aug 10 08:43:22.886034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 139/270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:22 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:22.994441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:23.001656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e785df46-51d3-4b91-9603-ad12bccdb471 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.152264 Aug 10 08:43:23.002219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 132/271] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:22 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:23.281028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:23.282258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:23.288555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:23.289037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:23.289473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:23.290159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:23.290646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:23.291072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:23.421668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:23.429108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8f528f02-4e56-4078-8acd-f4696478e1c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.152051 Aug 10 08:43:23.429716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 140/272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:23 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:23.906409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:23.907059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:23.913665 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:23.914141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:23.914599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:23.915278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:23.915723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:23.916142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:24.021923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:24.022557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:24.028368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:24.028850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:24.029280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:24.029994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:24.030447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:24.030899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:24.046595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:24.054486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-76aa1e02-6246-4737-b69a-c233297a4290 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.151865 Aug 10 08:43:24.055056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 133/273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:23 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:24.159612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:24.166976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b523b413-f336-4aea-a5be-4864a301bbde tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.148908 Aug 10 08:43:24.167548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 141/274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:24 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:24.450049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:24.450765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:24.457247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:24.457726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:24.458162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:24.458874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:24.459343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:24.459748 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:24.590372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:24.598820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-16bd303a-90b3-47b7-bab6-c70772fa2d59 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.152425 Aug 10 08:43:24.599442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 134/275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:24 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:25.075328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:25.076192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:25.082713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.083194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.083626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.084306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.084755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.085173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.189298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:25.189991 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:25.196718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.197207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.197645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.198333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.199081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.199511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.212185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:25.219702 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a09b12cb-ffef-4aa8-8e39-4fe5e744824f tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.148268 Aug 10 08:43:25.220277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 142/276] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:25 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:25.331876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:25.339333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2de255d8-1e10-40a2-a4c6-8a3c394c63e6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.154510 Aug 10 08:43:25.339921 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 135/277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:25 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:25.619542 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:25.620104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:25.626199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.626731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.627176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.628087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:25.628558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:25.628984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:25.698527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:25.719503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=12 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:25.768707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:25.776344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-884a1f02-d8d4-4178-af38-7d3afb8e3cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.160583 Aug 10 08:43:25.776920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 143/278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:25 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:26.240367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:26.240885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:26.242893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=10 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:26.248218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.248702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.249137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.249832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.250287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.250736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.360491 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:26.361096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:26.367195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.367683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.368115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.368795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.369358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.369765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.382987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:26.390796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-da976567-c98e-4130-8cfd-de8b0943eed2 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.154325 Aug 10 08:43:26.391367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 136/279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:26 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:26.499564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:26.507471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a22a6ebd-60d6-4f7b-8b9f-2a3d0955f947 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.151598 Aug 10 08:43:26.508035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 144/280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:26 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:26.796916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:26.797524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:26.803972 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.804453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.804895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.805600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:26.806018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:26.806435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:26.932413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:26.940978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-054260bf-b066-4488-8926-1ddc4e7306ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.147736 Aug 10 08:43:26.941594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 137/281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:26 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:27.413146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:27.413900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:27.420174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.420653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.421084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:27.421773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.422221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.422664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:27.529592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:27.530195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:27.536874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.537357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.537791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:27.538513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.538973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.539397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:27.551174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:27.560277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-31bc81a6-65a9-45c8-a789-ca5af45552ff tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.151505 Aug 10 08:43:27.560842 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 145/282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:27 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:27.671395 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:27.679426 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-950eddc4-7ae1-4e58-9fbb-4cd3fe080dc9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.153668 Aug 10 08:43:27.679997 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 138/283] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:27 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:27.962239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:27.962877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:27.968701 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.969184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.969619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:27.970865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:27.971324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:27.971746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.217712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:28.225777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0d929305-cdbf-4da5-8d42-7c6fef2f7dda tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.267362 Aug 10 08:43:28.226428 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 146/284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:27 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:28.581130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:28.581734 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:28.587957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:28.588426 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:28.588903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.589579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:28.590027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:28.590444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.700764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfce1f7b-950e-4f44-b507-2777908b6bcc", "tag": "cb93e78a-7098-4e86-b59d-f598a169da19"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:28.711616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:28.712378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:28.712976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.725531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] Creating event network-changed:cb93e78a-7098-4e86-b59d-f598a169da19 for instance bfce1f7b-950e-4f44-b507-2777908b6bcc on hv-cinder-78102 Aug 10 08:43:28.730568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:28.731177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-b3d397c2-ab48-4d4a-9e7b-3638dea83abd req-7ba45ec1-a0d5-4f15-9cbe-1f3bfb56cff0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034526 Aug 10 08:43:28.731778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 147/285] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:28.737441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:28.738139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:28.740093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:28.740550 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-26ff5b0a-0a28-4bca-8080-445fe6aabf89 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.163555 Aug 10 08:43:28.745057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:28.751777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:28.751777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.751777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:28.751777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:28.752265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:28.755991 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 139/286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:28 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:28.982416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:28.991068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c4a3fb92-db69-49b3-be05-f1e92bc4d602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.257999 Aug 10 08:43:28.991642 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 148/287] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:28 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:29.246856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:29.247388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:29.253883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:29.254360 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:29.263766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:29.263766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:29.263766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:29.263766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:29.405828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:29.408941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db10e43-3a1e-4f21-a834-f8f9e85dbf94", "name": "network-vif-plugged", "status": "completed", "tag": "ea8c7ee1-cefb-4b08-af72-d8f44ac5497b"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:29.417619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cd3b0585-8e3e-4aab-bba8-b832d94df6d0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.174761 Aug 10 08:43:29.418202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 140/288] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:29 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:29.419733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:29.420317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:29.420815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:29.434640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] Creating event network-vif-plugged:ea8c7ee1-cefb-4b08-af72-d8f44ac5497b for instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 on hv-cinder-78102 Aug 10 08:43:29.440152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-26b0c797-c6b2-4c87-ad9b-49d35598f850 req-e6284844-0277-4245-8eff-71a885c26acd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036089 Aug 10 08:43:29.441156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 149/289] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:43:29.764272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:29.764878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:29.771811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:29.772230 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:29.772670 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:29.773354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:29.773808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:29.774233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:29.909055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:29.916483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1efd233d-3c04-4fee-9dc2-4bc1947d71b3 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.156047 Aug 10 08:43:29.917050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 141/290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:29 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:30.012928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:30.013662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:30.020452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.020939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.021379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:30.022119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.022557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.023009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:30.149548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:30.156962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2673cf47-d2fa-4820-b80c-99e7ba186bcc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.148268 Aug 10 08:43:30.157781 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 150/291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:30 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:30.440335 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:30.440942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:30.447077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.447553 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.448007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:30.448681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.449128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.449549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:30.574683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:30.582687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e3b45357-6869-4360-9f6c-02f4691b1a20 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.146995 Aug 10 08:43:30.583377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 142/292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:30 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:30.937568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:30.938203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:30.944677 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.945678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.945678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:30.946567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:30.947019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:30.947435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:31.076646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:31.083912 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-52776093-8fef-48b1-aee3-3d7360888fe8 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.150676 Aug 10 08:43:31.084477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 151/293] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:30 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:31.177977 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:31.178610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:31.184738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:31.185217 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:31.185649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:31.186326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:31.186799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:31.187218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:31.319703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:31.327160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a6968d86-c660-4af1-8a03-002be78c5501 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.153288 Aug 10 08:43:31.327719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 143/294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:31 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:31.603637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:31.604174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:31.609947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:31.610428 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:31.610894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:31.611576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:31.612030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:31.612450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:31.744203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:31.752103 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6fc48ec3-3b24-4493-b91f-afa2c2dc50ea tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.151945 Aug 10 08:43:31.752659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 152/295] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:31 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:32.104888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:32.105546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:32.112090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.112563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.113038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.113723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.114183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.114636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.241611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:32.249246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8ee6162f-02d0-4d57-a54e-85fe1bb9be73 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.148232 Aug 10 08:43:32.249826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 144/296] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:32 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:32.347850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:32.348562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:32.354496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.354973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.355406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.356079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.356526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.356941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.486199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:32.494005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-87c76a4a-1959-43f1-9ae3-e5eafd67ee38 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.149572 Aug 10 08:43:32.494168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 153/297] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:32 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:32.772483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:32.773094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:32.774990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:32.779626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.780107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.780545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.781268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:32.781773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:32.782199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:32.911116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:32.918362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8ca804dd-99f7-4c94-bab7-3984b55f03c7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.149661 Aug 10 08:43:32.918971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 145/298] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:32 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:33.270221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:33.270769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:33.277061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.277573 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.277993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.278717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.279189 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.279596 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.412625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:33.420036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cbb47505-b3fd-4225-adef-565ad226fb70 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.153845 Aug 10 08:43:33.420608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 154/299] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:33 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:33.515526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:33.516012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:33.528096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.528096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.528096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.528096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.528517 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.528517 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.657893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:33.666387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f4b696ea-573b-4269-991f-1b1649d5df22 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.155086 Aug 10 08:43:33.666996 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 146/300] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:33 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:33.938943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:33.939560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:33.946511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.946511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.946944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.947632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:33.948088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:33.948510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:33.953116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:34.086979 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:34.094388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-97cf14da-9b65-4a67-85db-7857ee839cd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.159325 Aug 10 08:43:34.095049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 155/301] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:33 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:34.440847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:34.441542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:34.447653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:34.448128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:34.448558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:34.449232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:34.449679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:34.450098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:34.635867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:34.643892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ed58c3ea-48ab-476d-b087-f67c7b28d6da tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.207162 Aug 10 08:43:34.644461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 147/302] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:34 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:34.687704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:34.688310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:34.694182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:34.694704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:34.695143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:34.695824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:34.696283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:34.696705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:34.824584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:34.832018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a8129aab-6ea9-4a8f-bedb-be1319a2d1c4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.148171 Aug 10 08:43:34.833246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 156/303] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:34 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:35.116125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:35.116898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:35.123082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.123640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.124256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.124956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.125417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.125921 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.260116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:35.268072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-13cbe8bc-bc19-48d2-83bb-70f8e64c1a0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1367 microversion: 2.1 time: 0.156153 Aug 10 08:43:35.268633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 148/304] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:35 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:35.664113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:35.664744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:35.670728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.671207 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.675016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.675016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.675016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.675016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.807792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:35.815244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8f8216f7-e94e-40aa-a74d-23894ead3f86 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.154951 Aug 10 08:43:35.815805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 157/305] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:35 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:35.853493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:35.854097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:35.860791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.861264 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.861696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.862378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:35.862898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:35.863796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:35.868369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:36.009879 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:36.030762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-53b82905-f624-4d19-ad9b-c6412f4d728d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.168094 Aug 10 08:43:36.030762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 149/306] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:35 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:36.182764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfce1f7b-950e-4f44-b507-2777908b6bcc", "name": "network-vif-plugged", "status": "completed", "tag": "cb93e78a-7098-4e86-b59d-f598a169da19"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:36.192867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.193344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.193777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.204915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] Creating event network-vif-plugged:cb93e78a-7098-4e86-b59d-f598a169da19 for instance bfce1f7b-950e-4f44-b507-2777908b6bcc on hv-cinder-78102 Aug 10 08:43:36.210510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-b05f623e-0982-412d-b04c-fef36902b50a req-66c49370-a1bb-4ef9-9273-afc15ffd06e5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031562 Aug 10 08:43:36.211101 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 158/307] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:36.289716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:36.290319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:36.296731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.297409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.307089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.307089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.307089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.307089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.427682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:36.435117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2314520c-c057-47eb-acbe-94db04759bb2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1558 microversion: 2.1 time: 0.149742 Aug 10 08:43:36.435677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 150/308] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:36 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:36.458511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:36.459086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:36.465409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.465890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.466319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.467050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.467502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.467965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.544647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6a1aabaf-1667-45ec-9932-a593e5515dab tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090832 Aug 10 08:43:36.545306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 159/309] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:43:36 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:36.837513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:36.838115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:36.843935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.844413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.844998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:36.845853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:36.846304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:36.846765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:37.015973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:37.023522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-34d95f25-c5e7-441f-a4b2-aea12936a444 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.189751 Aug 10 08:43:37.024088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 151/310] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:36 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:37.041264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:37.041879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:37.049292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:37.049785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:37.050563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:37.051886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:37.052347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:37.052773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:37.307954 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:37.315792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-037f79b1-5654-4605-b64c-78118294f3d9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.278763 Aug 10 08:43:37.316347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 160/311] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:37 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:37.612967 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db10e43-3a1e-4f21-a834-f8f9e85dbf94", "tag": "ea8c7ee1-cefb-4b08-af72-d8f44ac5497b"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:37.632943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:37.632943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:37.632943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:37.638767 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] Creating event network-changed:ea8c7ee1-cefb-4b08-af72-d8f44ac5497b for instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 on hv-cinder-78102 Aug 10 08:43:37.645537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-fd3c0265-8721-48d7-baf6-4391a70ec92c req-fd92b848-b5c6-4cc3-924a-2d1883907636 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036312 Aug 10 08:43:37.646242 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 152/312] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:38.044917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:38.045523 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:38.052375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:38.052938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:38.053452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:38.054238 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:38.054773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:38.055666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:38.339191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:38.340702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:38.348312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:38.348885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:38.349399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:38.350187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:38.350717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:38.351389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:38.362950 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:38.373400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bf8df9e5-099f-4ab6-9d36-431c0e88d257 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.332302 Aug 10 08:43:38.385869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 161/313] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:38 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:38.505641 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:38.513753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b2aef26f-c833-43b7-946d-3531b5460d12 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.180590 Aug 10 08:43:38.514418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 153/314] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:38 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:39.395076 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:39.395861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:39.402295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:39.402812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:39.403236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:39.403932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:39.404375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:39.404812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:39.535341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:39.536247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:39.543087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:39.543573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:39.544006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:39.544704 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:39.545176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:39.545597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:39.680628 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:39.688371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-44d1f77f-4b7c-4827-92ba-78ba9ef38567 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.157257 Aug 10 08:43:39.688933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 154/315] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:39 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:39.748719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:39.756287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-88b11350-6b02-4a69-8146-40312dca9d65 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.365355 Aug 10 08:43:39.756845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 162/316] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:39 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:40.710355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:40.711059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:40.717592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.718073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.718531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.719298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.719793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.720277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.777251 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:40.778012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:40.784498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.788227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.788227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.788227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.788227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.788557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.856210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:40.864356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6aafbf41-2db3-4dc0-aca4-88d83b36b2f9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1501 microversion: 2.1 time: 0.158785 Aug 10 08:43:40.865482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 155/317] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:40 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:40.885251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64d9747e-fac0-4880-85bb-1c20831b707f"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:40.887633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:40.893626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.894111 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.894631 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.895328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.895785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.896216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.920027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] HTTP exception thrown: Cannot 'attach_volume' instance c375a801-702c-41d3-8546-9352f517d7fc while it is in vm_state rescued Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Request method failure captured: Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/os-volume_attachments HTTP/1.1 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 74 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829I0s8OLLd7kgYfQFsl1J1623noD67FD3sKctS7l0sDbxkw2bLNMkm4Gl7WZJOLtHfWtrg77e-tt47ew0CT7Gj2wgE5jDAaqLZzWzK8_vEjzgsw_k2syerqtpJMzWGToUkn_ddLyOOz7AgqW3rAA5u_P7tMgqIgyNeptsV1BWQzvs4 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:43:40.921797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5c6694dd460a467a986bcaa0e5e000a9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: d28b7a7b2e0143cf9ee6e761eb7fb281 Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {"volumeAttachment": {"volumeId": "64d9747e-fac0-4880-85bb-1c20831b707f"}} Aug 10 08:43:40.923147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Cannot 'attach_volume' instance c375a801-702c-41d3-8546-9352f517d7fc while it is in vm_state rescued Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'server_id': 'c375a801-702c-41d3-8546-9352f517d7fc', 'body': {'volumeAttachment': {'volumeId': '64d9747e-fac0-4880-85bb-1c20831b707f'}}} Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c375a801-702c-41d3-8546-9352f517d7fc in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:43:40.923910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c375a801-702c-41d3-8546-9352f517d7fc while it is in vm_state rescued Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:40.925089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c375a801-702c-41d3-8546-9352f517d7fc while it is in vm_state rescued Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Returning 409 to user: Cannot 'attach_volume' instance c375a801-702c-41d3-8546-9352f517d7fc while it is in vm_state rescued {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d2a3f962-0121-4276-a6e0-8363a2c69441 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042165 Aug 10 08:43:40.929281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 156/318] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:43:40 2022] POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 08:43:40.936094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:40.936618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:40.942560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:40.943919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.944408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.944835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.945531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:40.946041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:40.946708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:40.951417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-04b091e5-9cb6-44af-b6e3-5d395e34f916 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1313 microversion: 2.1 time: 0.178002 Aug 10 08:43:40.952074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 163/319] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:40 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:41.151719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-be69f036-69d7-4629-8b06-b6b0abc8e6cf tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/action" status: 202 len: 0 microversion: 2.1 time: 0.219103 Aug 10 08:43:41.152364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 157/320] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:43:40 2022] POST /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:43:41.161237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:41.161877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:41.171969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:41.171969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:41.171969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:41.171969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:41.172471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:41.172471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:41.304947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:41.317361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2b9ab6d6-ddc7-4020-9ff6-3d1bc081f522 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.160319 Aug 10 08:43:41.318425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 164/321] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:41 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:41.972555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:41.973257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:41.980928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:41.981411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:41.981841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:41.982618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:41.983072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:41.983497 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:42.124623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:42.132716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-61766594-2886-4cda-abed-19381222223b tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1498 microversion: 2.1 time: 0.164470 Aug 10 08:43:42.133276 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 158/322] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:41 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:42.338823 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:42.339463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:42.345414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:42.346129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:42.346589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:42.352248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:42.352248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:42.352248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:42.482128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:42.490260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1d3c1e46-5234-4d68-a838-2d3f8ce1d3aa tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.155379 Aug 10 08:43:42.490914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 165/323] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:42 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:43.311373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:43.311905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:43.318409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.323036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.323036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.323036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.323036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.323452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.345443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:43:43.511140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:43.511674 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:43.517464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.517942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.519976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.519976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.520199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.520528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.642642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-20ef8eee-599b-4f15-9ee0-1d3ff4d57d25 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 204 len: 0 microversion: 2.1 time: 0.334714 Aug 10 08:43:43.643711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 159/324] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:43:43 2022] DELETE /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:43:43.652723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:43.653418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:43.659844 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.660226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.660657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.661368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:43.661820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:43.662255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:43.697738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:43.705441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-82e7cef3-e53d-4d0a-9412-cc63ba18c153 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.198118 Aug 10 08:43:43.710544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 166/325] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:43 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:43.801192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:43.808752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6cc096e6-cb9e-437e-9fb2-25cb0c16b187 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1504 microversion: 2.1 time: 0.160120 Aug 10 08:43:43.809329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 160/326] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:43 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:44.728479 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:44.729021 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:44.734949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:44.735550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:44.735992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:44.736723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:44.737239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:44.737667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:44.830775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:44.831409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:44.839104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:44.839844 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:44.840507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:44.841283 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:44.841840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:44.842339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:44.872142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:44.879735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bd2c1ce2-44e2-4baa-9cfa-bdd9d87ded44 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.155243 Aug 10 08:43:44.880442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 167/327] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:44 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:44.979076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:44.986319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a47cf32c-b701-4a30-b6b0-bd71a9afd119 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1504 microversion: 2.1 time: 0.159471 Aug 10 08:43:44.986920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 161/328] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:44 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:45.900875 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:45.901485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:45.908008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:45.908482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:45.908909 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:45.909587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:45.910563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:45.910984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:46.006716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:46.007515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:46.013981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:46.014476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:46.014930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:46.015624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:46.016080 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:46.016513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:46.040857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:46.051221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bad1c0d6-1b0b-4531-8bce-c2b997623ffc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.152751 Aug 10 08:43:46.051835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 168/329] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:45 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:46.153483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:46.161664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5a185fa4-f438-4ba8-97b1-9283f0c68eed tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1504 microversion: 2.1 time: 0.158936 Aug 10 08:43:46.162226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 162/330] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:46 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:47.074420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:47.075047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:47.080879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:47.081357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:47.081788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:47.082494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:47.082936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:47.083359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:47.182815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:47.183544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:47.190753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:47.191260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:47.191818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:47.192604 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:47.193057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:47.193473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:47.219193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:47.227376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-251d5682-c76e-469f-83b3-eeec4d8d3ce6 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1509 microversion: 2.1 time: 0.157529 Aug 10 08:43:47.227944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 169/331] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:47 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:47.324353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:47.331800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a98fb29b-6ee3-409b-9b1c-ed68d08910dd tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1504 microversion: 2.1 time: 0.153108 Aug 10 08:43:47.332370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 163/332] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:47 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:48.249097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:48.249911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:48.256605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:48.257769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:48.258223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:48.258964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:48.259424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:48.259849 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:48.352072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:48.352709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:48.359482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:48.360042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:48.360482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:48.361174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:48.361623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:48.362040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:48.366779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:48.421688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:48.432928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ddda0aba-aefd-4165-bee5-b471f855b022 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1515 microversion: 2.1 time: 0.186778 Aug 10 08:43:48.446503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:48.446503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-77db19a0-416c-4eb7-ae21-d8dc53c908df tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1462 microversion: 2.1 time: 0.096070 Aug 10 08:43:48.446503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 164/333] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:48 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:48.448710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 170/334] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:48 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:48.489486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfce1f7b-950e-4f44-b507-2777908b6bcc", "name": "network-vif-deleted", "tag": "cb93e78a-7098-4e86-b59d-f598a169da19"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:48.498823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:48.499363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:48.499730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:48.511694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] Creating event network-vif-deleted:cb93e78a-7098-4e86-b59d-f598a169da19 for instance bfce1f7b-950e-4f44-b507-2777908b6bcc on hv-cinder-78102 Aug 10 08:43:48.516707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-f487926e-1abe-46ff-a408-8172d2b40ba5 req-339d74f9-85ce-41f1-b9dc-6b15febd1fbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Aug 10 08:43:48.518635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 165/335] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:49.468130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:49.468766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:49.475734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:49.476220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:49.476657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:49.477345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:49.477800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:49.478275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:49.509089 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:49.509570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:49.510002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:49.510442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lazy-loading 'fault' on Instance uuid bfce1f7b-950e-4f44-b507-2777908b6bcc {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:43:49.552214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '827e8de6dbf84bdd809a359b5bf5a6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3946b4be044dc892d608672069c366', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:49.559581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1e8dfabe-bbd9-4295-a2f1-0bea9e6a776c tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 200 len: 1303 microversion: 2.1 time: 0.095382 Aug 10 08:43:49.560159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 171/336] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:49 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:50.582311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:50.583455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] [instance: bfce1f7b-950e-4f44-b507-2777908b6bcc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:50.589962 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:50.590529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:50.593140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:50.593140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:50.593140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:50.593140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:50.605773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] HTTP exception thrown: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Request method failure captured: Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc HTTP/1.1 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829-NG0u6X581HNcHM459lWh2rV9qN9cnhylKrXOhoAuT2Oc6_bAEAbY_Dd74YxsquwuNdeilfopG24iSKCNsjPZ5Gl0CDqYwN6n0q1R8kfi5NZbRqKmNILJezo8TZCl_4aYkcpPqWP03NJw1F58b-9XNBbDowCbrgGhNKh8p3B95qg Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: ca3946b4be044dc892d608672069c366 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:43:50.607435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ca3946b4be044dc892d608672069c366"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ca3946b4be044dc892d608672069c366"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ca3946b4be044dc892d608672069c366"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ca3946b4be044dc892d608672069c366", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: ca3946b4be044dc892d608672069c366 Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesActionsTest-1410640087 Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesActionsTest-1410640087-project Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 827e8de6dbf84bdd809a359b5bf5a6cf Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesActionsTest-1410640087-project Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. Aug 10 08:43:50.608693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'bfce1f7b-950e-4f44-b507-2777908b6bcc'} Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:43:50.609389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. Aug 10 08:43:50.610519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:43:50.613611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] Returning 404 to user: Instance bfce1f7b-950e-4f44-b507-2777908b6bcc could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:43:50.613611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b4a728a7-f388-456b-b440-35dee45b30e4 tempest-VolumesActionsTest-1410640087 tempest-VolumesActionsTest-1410640087-project] 10.222.0.45 "GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc" status: 404 len: 111 microversion: 2.1 time: 0.031470 Aug 10 08:43:50.613611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 166/337] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:50 2022] GET /compute/v2.1/servers/bfce1f7b-950e-4f44-b507-2777908b6bcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:43:51.209027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d14c6dc3-3153-4390-a27b-e62985cf86ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: .version_select at 0x7fdef632d9d0>, body: {"keypair": {"name": "tempest-keypair-1473296745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqspIl/EZL0hqZSt9egwm/NkMHgjgdNzN2irSOmH8Nymo4AzEUnRk0Awz/xPHgzUcv/Yeee2zJXvSYFpWLVuse4JSMlfuIK9+lTfle0Re5v1JybfOWWJ/OMShcwFCLtcQ=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:51.221894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-d14c6dc3-3153-4390-a27b-e62985cf86ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:43:51.226023 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-d14c6dc3-3153-4390-a27b-e62985cf86ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for user d28b7a7b2e0143cf9ee6e761eb7fb281 and project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:43:51.333034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d14c6dc3-3153-4390-a27b-e62985cf86ce tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131535 Aug 10 08:43:51.333831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 172/338] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:43:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:43:53.860079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1429317246", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7368b221-cd07-48e6-8da6-73e91306248e"}], "security_groups": [{"name": "tempest-securitygroup--999898909"}], "key_name": "tempest-keypair-1473296745", "user_data": "}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:43:53.988479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] validate_networks() for [('7368b221-cd07-48e6-8da6-73e91306248e', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:43:54.393556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:43:54.394547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:43:54.395021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:43:54.395452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:43:54.395870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:43:54.405948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:54.406424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:54.407156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:54.407946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:54.408402 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:54.408828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:54.426492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:43:54.430394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Getting quotas for user d28b7a7b2e0143cf9ee6e761eb7fb281 and project 5c6694dd460a467a986bcaa0e5e000a9. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:43:54.441897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:43:54.444200 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:43:54.580040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3cb6e8b8-793e-4d52-9a64-18f370ea8e3c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.726508 Aug 10 08:43:54.580808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 167/339] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:43:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:43:54.593963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0cc86b26-1803-4c4f-91dd-497b25aee3a3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:54.593963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0cc86b26-1803-4c4f-91dd-497b25aee3a3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:54.646917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0cc86b26-1803-4c4f-91dd-497b25aee3a3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:54.656504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0cc86b26-1803-4c4f-91dd-497b25aee3a3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1246 microversion: 2.1 time: 0.068755 Aug 10 08:43:54.659350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 173/340] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:54 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:55.682954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:55.683570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:55.691895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:55.692381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:55.692982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:55.693846 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:55.694311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:55.695114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:55.759144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:55.767345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7fa48e43-6478-4547-b5ea-279d08270d8c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1250 microversion: 2.1 time: 0.089140 Aug 10 08:43:55.767844 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 168/341] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:55 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:56.789150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:56.789765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:56.798279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:56.798984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:56.799430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:56.800667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:56.801126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:56.801552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:56.827836 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:56.869860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:56.879116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-de8ce01f-cd7b-4719-a43a-ffc6abbaa9d8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1298 microversion: 2.1 time: 0.093717 Aug 10 08:43:56.879723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 174/342] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:56 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:43:57.905323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:57.909157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:57.933616 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:57.935098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:57.936403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:57.944938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:57.946149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:57.947102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:58.030804 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:58.042180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4bd832a2-6ad6-47fa-bb42-7a7b913997ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1304 microversion: 2.1 time: 0.145735 Aug 10 08:43:58.043394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 169/343] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:57 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:43:59.063213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:43:59.064417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:43:59.070632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:43:59.072270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:59.072870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:59.073314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:59.074050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:43:59.074522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:43:59.075122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:43:59.715086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:43:59.726188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-672cfec7-44de-40ee-a86b-4941f4f8f488 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.664814 Aug 10 08:43:59.730882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 175/344] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:43:59 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:00.473220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:00.491006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:00.491771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:00.492371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:00.516340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] Creating event network-changed:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:44:00.527419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-201ee339-b1aa-43d5-bfbb-4c039a292b89 req-bf3a42cc-274a-435a-a70d-a6c3549196cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057065 Aug 10 08:44:00.529550 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 170/345] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:00.747416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:00.753941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:00.764387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:00.765303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:00.766102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:00.767521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:00.769214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:00.769864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:01.228818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:01.237593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aa0d002b-b572-47e9-9568-18f3e53ca128 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.493931 Aug 10 08:44:01.240222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 176/346] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:00 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:02.265761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:02.269601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:02.285817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:02.286648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:02.287274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:02.288162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:02.288791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:02.289380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:02.727043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:02.736751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9e828348-df92-4598-9aab-9b0054078c7a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.476433 Aug 10 08:44:02.738323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 171/347] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:02 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:03.760082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:03.760900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:03.772565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:03.773194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:03.773729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:03.774565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:03.775127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:03.779000 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:04.027577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:04.039456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6e3008f4-77f6-4e48-9e14-646a6e97f41c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.283200 Aug 10 08:44:04.053161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 177/348] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:03 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:05.060483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:05.065112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:05.065112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:05.065112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=6 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:05.066171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:05.071601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:05.072326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:05.072760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:05.073462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:05.073915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:05.074347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:05.337204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:05.350074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-83b75b0e-bf3f-4091-a308-5f4f4ac0eedc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.293470 Aug 10 08:44:05.358223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 172/349] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:05 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:06.387219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:06.388049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:06.390122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:06.395862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:06.396429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:06.396931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:06.397638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:06.398096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:06.398543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:06.566114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:06.576208 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0a0901f5-1324-4e0b-b7fb-9868ed5e876d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.198956 Aug 10 08:44:06.577690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 178/350] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:06 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:07.617275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:07.617919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:07.657999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:07.662525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:07.663069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:07.663818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:07.664305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:07.669061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:08.027838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:08.044918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a0d0cb59-c62c-4d99-8d70-3e521a30a0e9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.431873 Aug 10 08:44:08.046816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 173/351] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:07 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:09.070017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:09.070944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:09.087859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:09.089064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:09.089759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:09.090923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:09.091756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:09.092449 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:09.600272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:09.621255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f0316820-294c-4589-a3c7-4cb232b9808b tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.548013 Aug 10 08:44:09.622792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 179/352] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:09 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:10.241461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "name": "network-vif-plugged", "status": "completed", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:10.274247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:10.274992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:10.275710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:10.296148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] Creating event network-vif-plugged:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:44:10.316828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-39d518d0-d847-4a98-a0a1-4ed145bedede req-6dc1730b-8fd8-409d-9840-700d97920c32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077517 Aug 10 08:44:10.317657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 174/353] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:10.648054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:10.648617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:10.660203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:10.675408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:10.685061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:10.685061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:10.685061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:10.685061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:10.979565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:10.988340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-66dbfbaa-0b13-40bb-b28c-eea30699e9da tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.346662 Aug 10 08:44:10.991175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 180/354] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:10 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:12.014405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:12.015819 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:12.031635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:12.033224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:12.034518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:12.035497 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:12.036140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:12.036872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:12.259784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:12.268235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-adc596cf-f35d-44a0-9233-b39c27df9214 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.259682 Aug 10 08:44:12.284770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 175/355] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:12 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:13.292864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:13.294244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:13.300615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:13.301767 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:13.302376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:13.303322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:13.303922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:13.304497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:13.498514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:13.506720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ec119dd3-763c-4dae-aade-e6a88cf5902d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1371 microversion: 2.1 time: 0.218169 Aug 10 08:44:13.520714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 181/356] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:13 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:14.529172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:14.530706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:14.538711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:14.539791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:14.540477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:14.541450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:14.542128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:14.542837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:14.730356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:14.739938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5c704e17-f709-4668-b051-3aa1162b7ee5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1566 microversion: 2.1 time: 0.215223 Aug 10 08:44:14.740564 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 176/357] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:14 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:14.761489 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:14.762071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:14.769206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:14.769783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:14.770292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:14.771180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:14.771725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:14.772218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:14.867569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5add480b-a2f3-4267-85b6-0e851dc9cd8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110547 Aug 10 08:44:14.868202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 182/358] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:44:14 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:16.349076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:16.368176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:16.368654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:16.369088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:16.399464 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] Creating event network-changed:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:44:16.405050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-165e93e2-aa84-4f3d-8369-a5f906d673ed req-b51d3aaf-84ec-4e38-85d8-4b0198cdc80e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059732 Aug 10 08:44:16.405693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 177/359] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:44:20.798620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a9983a36-11a3-4a64-974c-9b35da5c8632 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'create', calling method: .version_select at 0x7fdef63a7ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-463797268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHL7dhc8s1Urvb2wMCrR3ZGFCBmpxvVIqrdqPkWLhK+jh+3InV7awEGdUclQLl+0TsKNSJ+3ybLgTJbG4ahSilJFS4xRak3RLLPawtlPFawSRzAs7/q1V3+NxDxKSVCeg=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:20.813678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-a9983a36-11a3-4a64-974c-9b35da5c8632 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Getting quotas for project 970da6acbc464dee8191789eec7ba844. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:44:20.817504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-a9983a36-11a3-4a64-974c-9b35da5c8632 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Getting quotas for user 12404366fbba4d1dbb554dcfe65c34d9 and project 970da6acbc464dee8191789eec7ba844. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:44:20.928265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a9983a36-11a3-4a64-974c-9b35da5c8632 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.133801 Aug 10 08:44:20.928865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 183/360] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:44:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:20.982137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1989561370", "imageRef": "0e9b2167-f380-4981-abb6-c2db6f2fe1e9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-463797268", "networks": [{"uuid": "ba221f16-5b93-4a34-873f-e2000e699de4"}]}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:21.035943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] validate_networks() for [('ba221f16-5b93-4a34-873f-e2000e699de4', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:44:21.390820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:44:21.391245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:44:21.391715 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:44:21.392151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:44:21.392559 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:44:21.401431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:21.405136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:21.405136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:21.405136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:21.405136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:21.405556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:21.411094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=59 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:21.421595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Getting quotas for project 970da6acbc464dee8191789eec7ba844. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:44:21.426131 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Getting quotas for user 12404366fbba4d1dbb554dcfe65c34d9 and project 970da6acbc464dee8191789eec7ba844. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:44:21.437222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:44:21.439566 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0e9b2167-f380-4981-abb6-c2db6f2fe1e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:44:21.551552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-34825fa3-d536-4db1-896e-2be69e569158 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573429 Aug 10 08:44:21.554312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 178/361] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:44:21.563164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d2a32567-d86d-4742-a174-1f93fc504d11 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:21.563780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d2a32567-d86d-4742-a174-1f93fc504d11 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:21.616190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d2a32567-d86d-4742-a174-1f93fc504d11 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:21.622899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d2a32567-d86d-4742-a174-1f93fc504d11 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1258 microversion: 2.1 time: 0.063643 Aug 10 08:44:21.623485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 184/362] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:21 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:22.645253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b1613188-f7bb-4731-b8fd-741876d45f85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:22.645888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b1613188-f7bb-4731-b8fd-741876d45f85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:22.697447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b1613188-f7bb-4731-b8fd-741876d45f85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:22.711519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b1613188-f7bb-4731-b8fd-741876d45f85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1258 microversion: 2.1 time: 0.064066 Aug 10 08:44:22.711519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:22 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:23.725060 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:23.725644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:23.732376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:23.732854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:23.733287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:23.734035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:23.734536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:23.734943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:23.800359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:23.807830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bd63662a-40ae-49a1-b958-8e25a299e165 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1310 microversion: 2.1 time: 0.086601 Aug 10 08:44:23.808392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 185/364] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:23 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:24.829003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:24.829609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:24.837021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:24.837498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:24.837928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:24.838649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:24.839099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:24.839513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:25.094357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:25.108942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b4b2ff07-5477-4bb1-9c78-468544a0bd34 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.281551 Aug 10 08:44:25.110899 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 180/365] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:24 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:26.138908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:26.138908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:26.138908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:26.139636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:26.139636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:26.140249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:26.140706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:26.141132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:26.290500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:26.298940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0b93c3ed-54ea-49a9-912a-38a882a42d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.172308 Aug 10 08:44:26.301385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 186/366] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:26 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:27.321141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:27.321750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:27.332188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:27.334695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:27.334695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:27.334695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:27.334695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:27.335466 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:27.496817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:27.505740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8fc45f51-5283-42d2-9100-8e37b2315904 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.188822 Aug 10 08:44:27.506317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 181/367] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:27 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:28.527409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:28.528030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:28.534960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:28.535442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:28.537188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:28.537188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:28.537188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:28.537509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:28.675135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:28.678492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-78b0b12f-238c-49fc-bc5e-11c8bb2dd2b5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.155205 Aug 10 08:44:28.679061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 187/368] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:28 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:29.699177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:29.699781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:29.706519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:29.707003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:29.707442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:29.708148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:29.708602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:29.709022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:29.842925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:29.850308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-54c8ee13-05d7-4c85-b28d-2e5698c526fb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.154960 Aug 10 08:44:29.850912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 182/369] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:29 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:30.872181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:30.872785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:30.874715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:30.879818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:30.880295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:30.880723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:30.881402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:30.881886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:30.882301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:30.886112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=67 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:31.019274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:31.027414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b1e48de1-ca04-427b-aa58-88c9b736ef7d tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.159454 Aug 10 08:44:31.027988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 188/370] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:30 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:32.049003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:32.049663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:32.051712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:32.056736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:32.057223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:32.057668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:32.058357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:32.058844 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:32.059271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:32.206437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:32.214458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0e272212-80dd-4f71-af25-5bff174b5ce6 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.169794 Aug 10 08:44:32.215074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 183/371] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:32 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:33.235589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:33.236186 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:33.238547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:33.243693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:33.244183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:33.244684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:33.245476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:33.245934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:33.246415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:33.408655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:33.417747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bac08bf9-cc42-4618-8a92-78ae0721629a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.186425 Aug 10 08:44:33.419088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 189/372] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:33 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:34.441042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:34.442618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:34.444747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=8 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:34.451162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:34.452308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:34.453105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:34.454193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:34.454904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:34.455604 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:34.589850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:34.597951 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3116f706-f57c-4237-9af2-5d96594bf7ab tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.160744 Aug 10 08:44:34.598774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 184/373] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:34 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:34.815861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:34.816464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:34.822408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:34.822924 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:34.823372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:34.824057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:34.824514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:34.824937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:34.849896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5f0d7eb4-9481-4443-bd08-e30039b8ef09 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/ips" status: 200 len: 146 microversion: 2.1 time: 0.038253 Aug 10 08:44:34.851988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 190/374] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:44:34 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:35.619642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:35.620508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:35.627044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:35.628393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:35.628702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:35.629412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:35.629927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:35.630518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:35.773009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:35.780634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6a3f1bcd-6b5a-4745-9a97-807239150d35 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.164908 Aug 10 08:44:35.787904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 185/375] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:35 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:36.801923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:36.802572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:36.809563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:36.810054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:36.810535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:36.811258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:36.815791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:36.815791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:36.892528 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:36.899492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:36.906487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:36.915226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:36.915226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:36.915226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:36.915226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:36.915686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:36.942656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9922552a-7e2e-4e8c-b652-4826dce87660 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/ips" status: 200 len: 150 microversion: 2.20 time: 0.056897 Aug 10 08:44:36.951364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 186/376] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 10 08:44:36 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/ips => generated 150 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:44:37.019025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:37.025214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4243521a-92fa-4aff-9401-222a07af0f7a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.227718 Aug 10 08:44:37.045310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 191/377] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:36 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:38.050316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:38.051076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:38.053497 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:38.058482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:38.059107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:38.059626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:38.060505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:38.061075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:38.061674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:38.196595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:38.204954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a5ef059b-0cb0-40c7-be40-4745814f6845 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.159175 Aug 10 08:44:38.207784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 187/378] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:38 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:39.225903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:39.226543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:39.232454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:39.232939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:39.233376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:39.234055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:39.234533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:39.234974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:39.310140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "902f0126-0e2c-4303-b9dd-30f8288870d4"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:39.313084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:39.319657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:39.320140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:39.320579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:39.321272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:39.321734 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:39.322159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:39.365415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:39.372977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-13497d2b-7766-4517-9ccb-a04684800b49 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.150879 Aug 10 08:44:39.373628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 192/379] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:39 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:40.394611 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:40.396043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:40.401547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:40.402034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:40.402489 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:40.403182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:40.403635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:40.404060 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:40.531500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:40.538774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aab0359b-e0ec-4f86-aa6d-8e98dbcc60d3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.148212 Aug 10 08:44:40.539339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 193/380] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:40 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:40.583829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:40.584426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:40.590402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:40.590923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:40.591358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:40.592056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:40.592510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:40.592934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:40.615206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lazy-loading 'flavor' on Instance uuid 4806864d-f9df-4b0b-9b3d-6a0e2e960fda {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:44:41.138340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0048ea60-2562-4172-a8ce-704720fb8de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/action" status: 202 len: 0 microversion: 2.20 time: 0.558925 Aug 10 08:44:41.138951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 194/381] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 08:44:40 2022] POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 08:44:41.147442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:41.148121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:41.154220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:41.154731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:41.155163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:41.156091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:41.156540 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:41.156958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:41.291372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:41.299603 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:41.301148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:41.302810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3d666610-649f-4475-ae09-9f4244f925b1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.159332 Aug 10 08:44:41.303513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 195/382] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:41 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:44:41.559600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:41.560266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:41.566085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:41.566628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:41.567090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:41.567771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:41.568222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:41.568644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:41.823312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:41.831009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e32f38c5-988b-4237-a985-41c8e57b8cdf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.275101 Aug 10 08:44:41.831572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 196/383] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:41 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:42.325234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:42.325846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:42.332161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:42.332666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:42.333112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:42.333828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:42.334285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:42.334745 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:42.334849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-add96bcf-efa7-4030-9b1f-9d9b676b8f01 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.028363 Aug 10 08:44:42.335885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 188/384] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:44:39 2022] POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments => generated 194 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:44:42.669787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:42.683487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:42.683970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:42.684457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:42.694193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:42.696216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] Creating event network-changed:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:44:42.701564 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-8a56dd9d-ef4d-4d54-a4ee-2047984c6e9e req-60566151-9009-4a4b-babb-7cfacff3ce0b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Aug 10 08:44:42.702359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 189/385] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:44:42.704465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:42.705944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:42.707114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-68b2eb02-1ef4-46e3-b15e-61bce3aef916 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.385899 Aug 10 08:44:42.707687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 197/386] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:42 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:44:42.853170 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:42.854105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:42.861156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:42.861726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:42.862232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:42.863051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:42.863644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:42.864648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:43.008282 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:43.015738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bb8b1e0d-3866-4be2-867d-f219507098a9 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.167572 Aug 10 08:44:43.016296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 190/387] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:42 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:43.728985 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:43.729589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:43.735535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:43.736018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:43.736453 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:43.745780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:43.745780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:43.745780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:43.901874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:43.910009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:43.911529 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:43.912668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-944b88e3-d80d-456d-a49c-e1e31f30a4e9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.187526 Aug 10 08:44:43.913217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 198/388] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:43 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:44.036854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:44.037328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:44.043568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:44.044052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:44.044672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:44.045367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:44.045826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:44.046250 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:44.177781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:44.185082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2682bc0d-ab5b-4cc3-b662-2a7a5f1fff82 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.152583 Aug 10 08:44:44.185639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 191/389] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:44 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:44.935324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:44.942416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:44.942567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:44.943017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:44.943456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:44.944136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:44.944756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:44.945329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:45.196757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:45.205898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:45.206208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:45.207986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:45.208127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:45.209242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-291cbcca-59c0-4040-9585-6b040de4878f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.278120 Aug 10 08:44:45.209802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 199/390] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:44 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:45.230044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:45.230572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:45.231175 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:45.231884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:45.232339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:45.232754 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:45.364825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:45.372303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e639ebe3-e883-4c65-946b-e4b9446610db tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.169967 Aug 10 08:44:45.372860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 192/391] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:45 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:45.645114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:45.651387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:45.651873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:45.652301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:45.712473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Going to try to stop instance {{(pid=124810) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 08:44:45.947597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-97432d93-7b6c-444e-9085-f6fbc1d7079c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action" status: 202 len: 0 microversion: 2.1 time: 0.306480 Aug 10 08:44:45.948202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 200/392] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:44:45 2022] POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:44:45.955998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:45.956629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:45.962554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:45.963031 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:45.963458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:45.964134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:45.964583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:45.965002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:46.094146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:46.102624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-032b85e7-0b1b-4f0e-8528-455f0a086285 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.150319 Aug 10 08:44:46.103192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 193/393] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:45 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:46.233882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:46.234605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:46.240610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:46.241087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:46.241516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:46.242385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:46.242976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:46.243397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:46.373143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:46.381438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:46.382987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:46.384135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-50e2bc03-251c-429c-be4a-b7277edba340 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.154481 Aug 10 08:44:46.384716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 201/394] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:46 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:46.392785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:46.393495 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:46.400626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:46.401104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:46.401537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:46.402216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:46.402696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:46.403116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:46.525300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:46.532827 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1d2a48ea-a8bc-4118-b60a-84b3e6981078 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.143763 Aug 10 08:44:46.533394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 194/395] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:46 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:47.123478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:47.124081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:47.130436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.130938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.131374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.132048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.132500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.132919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.135511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:47.257729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:47.265571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e3796d1f-864d-483b-be89-d6e498fbf5e4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.145900 Aug 10 08:44:47.266134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 202/396] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:47 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:47.407065 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:47.407669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:47.413957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.414429 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.414889 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.415561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.416009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.416425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.539573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:47.547324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:47.548829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:47.549988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-075527bb-28d9-4c1c-9c85-15486f240061 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.147018 Aug 10 08:44:47.550556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 195/397] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:47 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:47.553740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:47.554500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:47.560446 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.560994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.561494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.562243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:47.562857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:47.563360 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:47.696960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:47.704527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a7565ec1-5446-4d70-b526-7c04ea108157 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.155299 Aug 10 08:44:47.705298 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 203/398] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:47 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:48.288572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:48.289108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:48.295126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.295597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.296025 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.296703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.297159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.297576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.302333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:48.433782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:48.441755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-73acf927-02de-4919-b3f3-8848a8bbe81c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.158311 Aug 10 08:44:48.442314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 196/399] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:48 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:48.573333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:48.573870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:48.579686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.580158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.580586 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.581262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.581712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.582655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.710118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:48.717999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:48.719527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:48.720673 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bca2f906-90b7-4b56-b7aa-5b7898e881af tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.151287 Aug 10 08:44:48.721277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 204/400] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:48 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:48.731571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:48.732176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:48.738134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.738683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.739705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.739816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:48.740218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:48.740639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:48.863988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:48.871345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b4f368c2-297e-42d0-8214-f2eb4dbd1e50 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.143961 Aug 10 08:44:48.871911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:48 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:49.463333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:49.463884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:49.469678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.470156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.470620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:49.471304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.471752 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.472172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:49.602794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:49.610722 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-16d3fbf5-0cfe-4989-a621-aaf43a308df4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.151302 Aug 10 08:44:49.611287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 205/402] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:49 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:49.744620 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:49.745181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:49.751614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.752108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.752546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:49.753287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.753759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.754169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:49.880663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:49.888467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:49.889968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:49.891158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-beaa4795-db58-42e9-87df-2e1eed3da9c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.150571 Aug 10 08:44:49.891710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 198/403] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:49 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:49.891809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:49.892405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:49.898748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.899226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.899653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:49.900334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:49.900779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:49.901194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:50.024363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:50.031921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3ca075db-b143-496d-a149-fb893c809ae0 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.143869 Aug 10 08:44:50.032488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:49 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:50.632895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:50.633507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:50.639415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:50.639894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:50.640330 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:50.641020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:50.641477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:50.641973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:50.767432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:50.775393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-dab8b810-0ab2-41bd-b984-03ad25a037c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.147090 Aug 10 08:44:50.775963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 199/405] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:50 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:50.915310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:50.915847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:50.921725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:50.922200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:50.922664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:50.923345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:50.923795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:50.924215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:51.049164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:51.053679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:51.054325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:51.057701 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:51.059229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:51.060204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:51.060370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-31cc0bc2-b7c8-4c2b-a6e0-73576e771fa5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.148997 Aug 10 08:44:51.060690 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:51.060919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 207/406] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:50 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:51.061130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:51.061851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:51.062312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:51.062763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:51.186398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:51.193841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3012f83f-6978-4b29-bf92-2f0a2dd02ec3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.144665 Aug 10 08:44:51.194531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 200/407] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:51 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:51.796839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:51.797370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:51.803316 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:51.803792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:51.804218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:51.804891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:51.805339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:51.805756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:51.931784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:51.939658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-658268d2-14df-45dd-ad65-f4577464e498 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.146789 Aug 10 08:44:51.940217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 208/408] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:51 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:52.082691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:52.083222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:52.089587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.090061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.090519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:52.091204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.091651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.092068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:52.214426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:52.215058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:52.220746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:52.220916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.221433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.221893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:52.222613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.223071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.223492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:52.229321 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:52.230944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:52.232158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e1d33595-f7fc-4ee6-9fa5-a6cc6b478cbe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.153447 Aug 10 08:44:52.232789 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 201/409] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:52 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:44:52.349529 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:52.356901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cee93183-4d5c-4b13-80d8-55df7b42b823 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.146446 Aug 10 08:44:52.357467 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:52 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:52.961506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:52.962116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:52.968013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.968495 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.968949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:52.969614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:52.970071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:52.970512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:53.093701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:53.102033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-be10f248-2cce-4702-a652-440bcf5d1deb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.144906 Aug 10 08:44:53.102616 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 202/411] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:52 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:53.255686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:53.256223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:53.262162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:53.262684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:53.263122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:53.263804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:53.264308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:53.264732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:53.378454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:53.380210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:53.387063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:53.387685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:53.388123 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:53.389339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:53.389796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:53.390220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:53.398951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:53.407167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:53.411378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:53.412579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-681f1f12-8a1c-4a11-8e9e-ccd25d199786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.161372 Aug 10 08:44:53.413459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 210/412] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:53 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:53.532062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:53.540357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-98e21e36-3d27-428e-b79d-c22ad60a92d2 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.167002 Aug 10 08:44:53.551798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 203/413] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:53 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:54.123290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:54.123816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:54.129691 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.130169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.130640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.131320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.131772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.132186 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.257963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:54.266010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8d59b887-ae11-47d7-8804-5fb9770df98a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.146636 Aug 10 08:44:54.266592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 211/414] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:54 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:54.438299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:54.438933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:54.445402 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.445883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.446324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.447044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.447504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.447932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.561051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:54.561656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:54.567469 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.568322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.568322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.569018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:54.569470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:54.569888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:54.575358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:54.585568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:54.587150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:54.588323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-542cbb95-25d4-4270-a50a-6f15541f46fa tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.153920 Aug 10 08:44:54.589248 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 204/415] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:54 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:54.696983 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:54.704566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7557afd0-5d26-4e47-b1df-b846e5f5ac20 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.147275 Aug 10 08:44:54.705133 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 212/416] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:54 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:55.020051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "name": "network-vif-plugged", "status": "completed", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:44:55.029480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.030012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.030733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.042808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] Creating event network-vif-plugged:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:44:55.047964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-cbdeb297-0e40-44b6-9d45-1ab97cb22358 req-ad203620-c52f-4687-9612-bb0c7df7f4d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031545 Aug 10 08:44:55.048562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 205/417] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:55.287036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:55.287640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:55.293519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.294000 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.294430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.295141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.295594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.296020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.469519 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:55.482873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a2b134d6-bbd5-4cb9-9a93-e6a259185aa3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.199662 Aug 10 08:44:55.483537 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 213/418] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:55 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:55.612927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:55.614251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:55.620390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.620867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.621301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.621975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.622422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.622864 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.725585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:55.726195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:55.732083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.732564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.732998 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.733709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:55.734164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:55.734613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:55.753982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:55.762199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:55.763706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:55.764858 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-55a94b73-751e-45f8-8720-a1035efa3fc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.156903 Aug 10 08:44:55.765415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 206/419] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:55 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:55.865220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:55.872614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-968f5b8b-98a4-4b76-8e18-975f96c2223e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.151386 Aug 10 08:44:55.873178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 214/420] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:55 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:56.504921 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:56.505521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:56.511365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.511843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.512275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.512950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.513399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.518425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.673676 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:56.682241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-27af719a-1287-4f99-9521-bc479fadc0ba tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.181833 Aug 10 08:44:56.682839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 207/421] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:56 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:56.787812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:56.788419 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:56.794296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.794817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.795253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.795939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.796393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.796818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.893264 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:56.893995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:56.900004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.900499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.900940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.901634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:56.902093 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:56.902542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:56.939730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:56.948164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:56.949668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:56.950878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ca9b894c-17df-463f-babb-c92a02774f3a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.166991 Aug 10 08:44:56.951461 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 215/422] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:56 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:57.036568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:57.043946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bd511f19-484d-4973-a0be-b702c9b8550f tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1358 microversion: 2.1 time: 0.154453 Aug 10 08:44:57.044640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 208/423] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:56 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:57.705136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:57.705838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:57.713398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:57.713964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:57.714564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:57.715900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:57.716371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:57.716799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:57.852953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:57.861025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bdf9fabe-56f9-449d-8452-d4c4f5e38d8f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.159871 Aug 10 08:44:57.861626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 216/424] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:57 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:57.974929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:57.975527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:57.982242 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:57.982814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:57.983287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:57.983984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:57.984470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:57.985035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.065381 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:58.065907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:58.072875 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.076198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.076198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.076198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.076198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.076597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.135378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.143230 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.144735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.145892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-28802675-ea25-47ca-81a2-92a59460ab2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.175094 Aug 10 08:44:58.146446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 209/425] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:57 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:44:58.208151 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.216015 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1f0cda8d-94ae-48ff-abd1-bcc3f136647e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1547 microversion: 2.1 time: 0.154654 Aug 10 08:44:58.219466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 217/426] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:58 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:58.236294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:58.236900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:58.243271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.243750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.244179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.244863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.245302 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.245747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.440128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.449814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c8fa4993-7a6e-44c1-ac3d-743c5ef5454c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1547 microversion: 2.1 time: 0.217138 Aug 10 08:44:58.450575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 210/427] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:58 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:58.469686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:58.475690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.476478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Searching by: {'deleted': False, 'project_id': '970da6acbc464dee8191789eec7ba844'} {{(pid=124810) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 08:44:58.483623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.484102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.484535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.485257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.485712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.486135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.580084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.multi_cell_list [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124810) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 08:44:58.606504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:44:58.679698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-14b23944-ddfb-49b4-9945-1dfd3b6c8a8b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213871 Aug 10 08:44:58.680484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 218/428] 10.222.0.45 () {58 vars in 1125 bytes} [Wed Aug 10 08:44:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:44:58.691229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:58.691992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:58.698075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.698642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.699078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.701074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.701074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.701074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.829614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:58.837941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f2d2ff4d-4323-4731-ab7f-8bde63bd19e7 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1547 microversion: 2.1 time: 0.150454 Aug 10 08:44:58.838852 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 211/429] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:58 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:44:58.882153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:58.883338 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:58.889398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.889884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.890319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:58.891053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:58.891720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:58.892145 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:59.032944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:59.041595 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-efa36604-8ad1-4c62-bf71-6325eb7d6808 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.163294 Aug 10 08:44:59.042155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 219/430] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:44:58 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:44:59.167814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:44:59.169015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:44:59.189154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:59.195308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:59.195989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:59.199185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:44:59.199665 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:44:59.202556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:44:59.383514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:59.392224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:59.393762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:44:59.395556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a5f5b332-ca09-4ac9-8f35-92626b477b5f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.231654 Aug 10 08:44:59.396132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 212/431] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:44:59 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:00.063016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:00.063534 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:00.069417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:00.069896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:00.070329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:00.071040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:00.071487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:00.071908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:00.228205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:00.228205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-202656e6-8acc-4357-9ecd-780500f37ff6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.165948 Aug 10 08:45:00.228205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 220/432] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:00 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:00.419974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:00.420576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:00.428980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:00.429535 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:00.430160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:00.431095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:00.431556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:00.431984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:00.447711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:00.843133 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:00.854851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:00.856337 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:00.857616 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-53233691-df25-492b-9c29-09984a92accf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.441918 Aug 10 08:45:00.858205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 213/433] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:00 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:01.246656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:01.247446 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:01.255686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.256475 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.257310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:01.258019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.258493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.259082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:01.425811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:01.438861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3eb49c05-c402-4d49-8cbb-f4c66a076f34 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.196268 Aug 10 08:45:01.450546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 221/434] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:01 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:01.881853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:01.882453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:01.889644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.890446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.891387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:01.892313 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.892973 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.893727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:01.933564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78a7ca72-a7b2-4fd9-ab75-91eff424966c"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:01.937161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:01.949248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.949980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.950620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:01.951313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:01.951981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:01.952624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:02.109627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:02.119823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:02.121857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:02.123079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f327cb2d-d7cb-42e8-a890-987629d8d74b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.245713 Aug 10 08:45:02.124136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 214/435] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:01 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:02.206857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:45:02.207062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 08:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 08:45:02.462446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:02.462708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:02.468479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:02.468968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:02.470063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:02.470783 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:02.471245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:02.471672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:02.633184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:02.641524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e2dac624-b901-47db-8116-435f451072fb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.184014 Aug 10 08:45:02.642551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 215/436] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:02 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:02.779439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-64afef30-d09d-4f42-a3f1-f4f11a87fdff tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856896 Aug 10 08:45:02.783081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 222/437] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:45:01 2022] POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:45:03.146686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:03.147331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:03.153779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:03.154260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:03.154798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:03.155818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:03.156275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:03.156871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:03.333962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "name": "network-vif-plugged", "status": "completed", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:03.339154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=70 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:03.347412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:03.348501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:03.348938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:03.363452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] Creating event network-vif-plugged:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:45:03.368556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-c56e3770-7440-47c7-a356-8550503d4452 req-b29f9eeb-6100-4d77-bbec-c9b3ca36b26f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Aug 10 08:45:03.371211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 223/438] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:03.393421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:03.402153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:03.404280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:03.406037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4ba085d2-eeb0-4c9a-9f08-5fcb3cc07a92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.263461 Aug 10 08:45:03.407103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 216/439] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:03 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:03.678456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:03.679438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:03.686123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:03.686843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:03.687434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:03.690774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:03.691334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:03.691933 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:03.866105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:03.878209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a3e30d9d-3484-4bd7-8c80-0925311cdd17 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1724 microversion: 2.1 time: 0.217186 Aug 10 08:45:03.879124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 224/440] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:03 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:04.429055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:04.429710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:04.436386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:04.436871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:04.437305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:04.438052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:04.438529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:04.447150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:04.576292 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:04.585032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:04.586695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:04.590418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-61da0220-cd30-4308-9112-2bfb0f9f8d87 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.162687 Aug 10 08:45:04.590418 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 217/441] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:04 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:04.902976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:04.903581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:04.910609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:04.911086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:04.911514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:04.912237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:04.912688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:04.913109 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.076346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:05.091026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d2679a23-21c2-45ba-944e-e46197ce1030 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1701 microversion: 2.1 time: 0.186361 Aug 10 08:45:05.091026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 225/442] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:04 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1701 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:05.110326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:05.116821 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:05.117658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:05.118166 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.182568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Going to try to start instance {{(pid=124809) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 08:45:05.610559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:05.611216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:05.618210 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:05.618788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:05.619355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.620158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:05.620739 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:05.621388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.723877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5d64b024-43f3-4a48-9704-ffd1647357e1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action" status: 202 len: 0 microversion: 2.1 time: 0.616400 Aug 10 08:45:05.729389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 218/443] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:45:05 2022] POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:45:05.735639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:05.736684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:05.744833 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:05.745964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:05.746674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.747626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:05.748295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:05.749067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:05.783668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:05.793375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:05.794974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:05.796268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-38179ac8-c177-49be-a018-6e1107a5c051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.189916 Aug 10 08:45:05.797096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 226/444] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:05 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:05.912279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:05.920187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bc1065f0-612e-4f4c-be14-49605e8a4947 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1710 microversion: 2.1 time: 0.189329 Aug 10 08:45:05.920878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 219/445] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:05 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:06.819771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:06.821131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:06.827961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:06.828812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:06.829463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:06.830829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:06.831497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:06.832682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:06.944033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:06.944668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:06.953985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:06.954678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:06.955283 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:06.962921 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:06.963667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:06.965336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:07.044885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:07.058833 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:07.061755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:07.063318 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-05a8b16c-2992-4c20-9f6d-64401d6bb774 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1744 microversion: 2.20 time: 0.248304 Aug 10 08:45:07.064343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 227/446] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:06 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:07.451295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:07.462398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b20aea03-417b-4705-9a58-36e888920592 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1710 microversion: 2.1 time: 0.522640 Aug 10 08:45:07.463477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 220/447] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:06 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1710 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:08.087139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:08.089961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:08.095198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:08.095683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:08.096409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:08.097117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:08.098191 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:08.098682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:08.291273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:08.305764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:08.307645 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:08.309216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bafabd03-1857-4b93-8c28-262a84b5c891 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.225786 Aug 10 08:45:08.309942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 228/448] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:08 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:08.484980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:08.487370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:08.493695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=68 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:08.495470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:08.496117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:08.496701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:08.497594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:08.498396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:08.499108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:08.735518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:08.747472 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-40b4b6ee-ddde-48a9-b57a-b73c175609b2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1714 microversion: 2.1 time: 0.265958 Aug 10 08:45:08.747793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 221/449] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:08 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1714 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:09.336172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:09.339356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:09.344872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:09.352341 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:09.355314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:09.355314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:09.355314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:09.355314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:09.356206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:09.693539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:09.693539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:09.694535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:09.701082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a59692a9-bcec-4b89-8e00-3a5448bd85df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.367919 Aug 10 08:45:09.703151 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 229/450] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:09 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:10.725530 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:10.726824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:10.740962 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:10.751279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:10.751747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:10.752501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:10.752964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:10.753560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:11.048851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:11.075835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:11.081833 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:11.083375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c5d25967-c747-480b-aa25-7891c0e19448 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.361825 Aug 10 08:45:11.103970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 222/451] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:10 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:11.916721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:11.918091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:11.946750 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a752f059-c0cd-44d1-9647-439ca9b3b344 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Action: 'create', calling method: .version_select at 0x7fdef5a385e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-993683958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSQkaO2zgxjDYPw4gmcnIiNPS6C9GnSziTn5CTV9GfFrBlWNFR/IcX3QHPpmQv02hGch5F6kIrjVhwVLR6KxMVGN9wpppKgxxWkQsQUnVs2M6MGB3M14IhIT+uv4gFJvQ=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:11.948236 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:11.948777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:11.949171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:11.949885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:11.950347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:11.950808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:11.967753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-a752f059-c0cd-44d1-9647-439ca9b3b344 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for project b3230d51d63a4f9a9d47624c553242f4. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:45:11.972172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-a752f059-c0cd-44d1-9647-439ca9b3b344 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for user f1c7a90e90e5411f92eddd180ef9e27d and project b3230d51d63a4f9a9d47624c553242f4. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:45:12.068538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a752f059-c0cd-44d1-9647-439ca9b3b344 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.386713 Aug 10 08:45:12.069949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 230/452] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:45:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:12.110898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:12.111571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:12.123258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:12.123663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:12.124097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:12.124805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:12.125258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:12.128946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:12.165663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:12.176652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4388d4e9-d266-4b22-a3ef-b42afc434c85 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1593 microversion: 2.1 time: 0.263613 Aug 10 08:45:12.177942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 223/453] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:11 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1593 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:12.486872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:12.519499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:12.523421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:12.526853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1a5fd176-7a99-4c48-a85d-981d96a95de1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.418206 Aug 10 08:45:12.527586 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 231/454] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:12 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:13.554455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:13.555255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:13.578345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:13.578345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:13.578345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:13.578345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:13.578788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:13.578788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:13.967303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:13.992048 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:13.993668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:13.995598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7926c6b7-117f-4f7c-a019-6789f8c20c27 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.446432 Aug 10 08:45:13.997263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 224/455] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:13 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:15.023332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:15.024105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:15.038127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:15.047282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:15.048091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:15.049104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:15.049798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:15.051003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:15.342401 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:15.356292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:15.358809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:15.360255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-56f104c4-6075-4da4-8c2f-d049cbc846e1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.341139 Aug 10 08:45:15.361378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 232/456] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:15 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:16.032628 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:16.046677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:16.048509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:16.048966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:16.074978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] Creating event network-changed:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:45:16.082240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-204ec8c0-09a7-4baa-8476-c8573ab7f90c req-fc237918-6bfc-49a1-acdc-5b69bc500eaa service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055378 Aug 10 08:45:16.083193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 225/457] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:16.384139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:16.384789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:16.391230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:16.391715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:16.392149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:16.393015 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:16.404393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:16.404393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:16.847826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:16.859365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:16.864224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:16.868263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ae927dcb-161f-48ad-80d5-5684852dc82f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.487844 Aug 10 08:45:16.868926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 233/458] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:16 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:17.894975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:17.895803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:17.915203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:17.915939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:17.916533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:17.917487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:17.919906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:17.920708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:18.182651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:18.192391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:18.194268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:18.199251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b5298d0c-438e-4051-a90d-45184742a985 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.307528 Aug 10 08:45:18.200492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 226/459] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:17 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:19.226560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:19.227365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:19.237121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:19.238945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:19.238945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:19.239180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:19.239795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:19.240223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:19.397637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:19.407132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:19.410088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:19.410554 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-db61e072-7087-4346-8512-af75cd12dc0f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.189862 Aug 10 08:45:19.411166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 234/460] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:19 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:19.992381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:19.996607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:20.000381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.000875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.001314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.002124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.002879 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.003835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.038980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7358fe5b-2d0f-4934-820a-0253bf7ac66b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/ips" status: 200 len: 149 microversion: 2.1 time: 0.054722 Aug 10 08:45:20.039560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 227/461] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:45:19 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:20.082008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-365796092"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:20.082865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:20.105871 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.106787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.107432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.108399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.109102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.109749 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.151064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:20.308203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.network.security_group_api [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Adding security group 29b27965-c44f-4d6f-bd95-980a79040fde to port 4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 Aug 10 08:45:20.443304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:20.462684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:20.462684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.462684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.462684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.463414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.463414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.463414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.711421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:20.741345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:20.741345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:20.741345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ba74fd4a-bf85-4764-898e-d4ee694cb4da tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.308836 Aug 10 08:45:20.741610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 228/462] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:20 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:20.948729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4d517f6e-2b5f-46ad-8c90-5e20182068f3 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action" status: 202 len: 0 microversion: 2.1 time: 0.871444 Aug 10 08:45:20.949989 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 235/463] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:45:20 2022] POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:45:20.963772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:20.963772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:20.968469 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.968960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.969399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.970132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:20.970578 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:20.971006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:20.986119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:21.013791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:21.014205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:21.014660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:21.033175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] Creating event network-changed:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:45:21.059026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-c70f6018-523e-46f3-af57-d9ed8b1a9f83 req-2d811d7e-70da-4938-8934-44b2242e09a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071882 Aug 10 08:45:21.059026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 236/464] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:21.264142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:21.280602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-73bc9f64-5ad1-45aa-9781-0e1fbaf7458e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1758 microversion: 2.1 time: 0.326476 Aug 10 08:45:21.282226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 229/465] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:20 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1758 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:21.767274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:21.768031 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:21.789009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:21.790806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:21.791250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:21.791965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:21.795238 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:21.797647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:21.981497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=4 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:22.004732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:22.014346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:22.016252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:22.017416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1f437c4f-ad1c-4f97-a9b8-f3169f8829c8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.256295 Aug 10 08:45:22.018138 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 237/466] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:21 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:23.040579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:23.041163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:23.047525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:23.048012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:23.048444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:23.049123 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:23.049698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:23.050290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:23.055971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:23.183216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:23.192472 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:23.193987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:23.195192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-81400180-4336-47d1-8e24-cefdefac0f7e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1739 microversion: 2.20 time: 0.158708 Aug 10 08:45:23.195749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 230/467] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:23 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:23.291623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da42e170-64c2-43b3-94c5-352c6a02e088"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:23.293913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:23.300200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:23.300682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:23.301115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:23.301797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:23.302252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:23.302701 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:24.218156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:24.218946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:24.225720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:24.226203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:24.226667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:24.227370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:24.227832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:24.228252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:24.377100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:24.385239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:24.386769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:24.387946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d6cde929-8817-4156-bff6-53c55f441a93 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1721 microversion: 2.20 time: 0.173640 Aug 10 08:45:24.388509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 231/468] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:24 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:24.663997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0b6c6dcc-08b1-40d3-bd23-8e23a410d886 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.376141 Aug 10 08:45:24.665249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 238/469] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:45:23 2022] POST /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 194 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:25.412107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:25.412704 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:25.419144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:25.419626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:25.420057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:25.420729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:25.421181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:25.421600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:25.550003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:25.558483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:25.559964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:25.561096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ea97cdcf-4934-4d52-8a6f-bca038cfed74 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1721 microversion: 2.20 time: 0.153386 Aug 10 08:45:25.561681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 232/470] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:25 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:26.583872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:26.584684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:26.591353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:26.591831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:26.592262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:26.592938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:26.593386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:26.593804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:26.729319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:26.738244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:26.740535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:26.741974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1e81e23f-254c-48df-9eb0-3096cf7a2614 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1721 microversion: 2.20 time: 0.162349 Aug 10 08:45:26.742591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 239/471] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:26 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:27.082758 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "name": "network-vif-unplugged", "status": "completed", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:27.096124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:27.096680 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:27.097183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:27.110182 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] Creating event network-vif-unplugged:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:45:27.115914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-212d08ab-b9ca-40b2-8a51-fcf507d55a47 req-4807c0d7-1728-4551-a110-3974e1cc0d87 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037051 Aug 10 08:45:27.116485 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 233/472] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:45:27.765595 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:27.766182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:27.772676 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:27.773148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:27.773581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:27.774272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:27.774757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:27.775176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:27.916563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:27.926248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:27.932190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:27.932190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-865f5bfb-1eca-442b-ab8e-49165581c256 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1724 microversion: 2.20 time: 0.168169 Aug 10 08:45:27.932190 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 240/473] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:27 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:27.953684 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aaae1ff-1156-48bf-adfa-6610f193adaa"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:27.956089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:27.964601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:27.965075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:27.965501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:27.966243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:27.966714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:27.967133 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:28.960538 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-474d4818-08ba-4644-aeaa-0fe05e2e178e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.011077 Aug 10 08:45:28.961319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 234/474] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 10 08:45:27 2022] POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments => generated 188 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:45:29.084585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:29.085184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:29.091675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:29.092194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:29.092638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:29.093325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:29.093779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:29.094205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:29.138202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124810) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 08:45:29.426232 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-66291e3e-e1f3-4f75-a05c-764fb95bceef tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/action" status: 202 len: 0 microversion: 2.20 time: 0.345640 Aug 10 08:45:29.427387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 241/475] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 08:45:29 2022] POST /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:45:29.435536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:29.436412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:29.443485 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:29.447078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:29.447531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:29.448275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:29.449598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:29.450028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:29.588058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:29.596712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:29.598187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:29.599507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-252d30d3-b7a8-4dd4-b9b5-c9418b2b3fdf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1750 microversion: 2.20 time: 0.168017 Aug 10 08:45:29.600060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 235/476] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:29 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:30.623483 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:30.624088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:30.630517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:30.631057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:30.631464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:30.632226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:30.632676 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:30.633093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:30.761395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:30.769842 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:30.772028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:30.777789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-06389efa-a085-4610-b47b-5582e845de25 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1750 microversion: 2.20 time: 0.154070 Aug 10 08:45:30.777789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 242/477] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:30 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:31.795605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:31.796132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:31.802247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:31.802769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:31.803204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:31.803923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:31.804377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:31.804808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:31.929417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:31.937761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:31.939305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:31.940485 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-90b846f7-feb2-420c-9dab-f0a37c991d13 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1752 microversion: 2.20 time: 0.149096 Aug 10 08:45:31.941042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 236/478] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:31 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:32.963467 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:32.964073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:32.970214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:32.970722 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:32.971157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:32.971828 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:32.972276 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:32.972692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:33.100453 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:33.108719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:33.110183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:33.111338 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-767ef1a6-9f5e-492f-8a93-8f96d9554535 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1752 microversion: 2.20 time: 0.151773 Aug 10 08:45:33.111892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 243/479] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:32 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:34.135028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:34.135623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:34.141978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:34.142498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:34.142933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:34.143631 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:34.144075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:34.144491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:34.279216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:34.287839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:34.289327 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:34.290491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ae69bbb9-c0c5-48f0-94b2-84bdb19d9516 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1752 microversion: 2.20 time: 0.159314 Aug 10 08:45:34.291057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 237/480] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:34 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:35.313315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:35.314059 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:35.316672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:35.321773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:35.322297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:35.322749 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:35.323463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:35.323940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:35.324353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:35.356531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-49fca5a5-c449-4e92-977f-c27880721081 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: .version_select at 0x7fdef520b5e0>, body: {"keypair": {"name": "tempest-keypair-616913050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP2jpWC4g9RCoYNsKRMhLK4Ktv2xAG8ahN/gMW5LjXwrl8JXrQ47xj5fMa83OaHNWIHoNkuurMoxOkhnjep4kaGopihvNnjKYned62LOG5V55F4pwOvwY0YeYNBrWR+fQ=="}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:35.372302 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-49fca5a5-c449-4e92-977f-c27880721081 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:45:35.376374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-49fca5a5-c449-4e92-977f-c27880721081 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:45:35.457074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:35.466362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:35.467876 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:35.469194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5beabf02-2e77-4b63-a8c0-55c0620fef11 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1752 microversion: 2.20 time: 0.159938 Aug 10 08:45:35.470154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 244/481] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:35 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:35.479592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-49fca5a5-c449-4e92-977f-c27880721081 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126773 Aug 10 08:45:35.485359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 238/482] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:45:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:45:36.493085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:36.493697 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:36.500067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:36.500552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:36.501162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:36.501699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:36.502153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:36.502605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:36.636247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:36.644699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:36.646185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:36.647365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-67f2684e-db53-49e4-bfc2-743764c097fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.158684 Aug 10 08:45:36.648511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 245/483] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:36 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:37.672198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:37.672821 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:37.687035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:37.687035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:37.687035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:37.687035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:37.687577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:37.687577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:37.691382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1284023998", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec743362-15f5-4239-ba7d-fe3ce8ba53bc"}], "security_groups": [{"name": "tempest-securitygroup--427516106"}], "key_name": "tempest-keypair-616913050", "user_data": "}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:37.793915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] validate_networks() for [('ec743362-15f5-4239-ba7d-fe3ce8ba53bc', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:45:37.817647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:37.826983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:37.828513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:37.829673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-547c2862-c64b-43c9-a93d-9f741a2c7d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.162126 Aug 10 08:45:37.830282 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 239/484] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:37 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:38.212288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:45:38.212905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:45:38.213561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:45:38.214126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:45:38.214715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:45:38.224474 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:38.224951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:38.225382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:38.226162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:38.226643 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:38.227095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:38.244082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:45:38.248492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:45:38.260556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:45:38.262854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:45:38.421838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-47891e96-5982-430d-9948-ac6e25edd5f9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.734898 Aug 10 08:45:38.428502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 246/485] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:45:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 08:45:38.438723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-88edb83d-9e3a-45f3-89fa-5ad771e5846d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:38.439675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-88edb83d-9e3a-45f3-89fa-5ad771e5846d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:38.513870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-88edb83d-9e3a-45f3-89fa-5ad771e5846d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:38.520807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-88edb83d-9e3a-45f3-89fa-5ad771e5846d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1241 microversion: 2.1 time: 0.090290 Aug 10 08:45:38.526888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 240/486] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:38 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:38.854894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:38.856025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:38.863487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:38.864347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:38.865020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:38.866106 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:38.867147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:38.867806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:39.037706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:39.046721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:39.050244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:39.050244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cdfef586-523e-4a76-9282-75686c807a68 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.200606 Aug 10 08:45:39.050244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 247/487] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:38 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:39.541537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:39.542153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:39.544606 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:39.549709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:39.550766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:39.550984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:39.552429 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:39.552996 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:39.553564 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:39.625308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:39.633424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4f376fef-063f-4816-95e6-e5efadbb86d3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.096141 Aug 10 08:45:39.634120 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 241/488] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:39 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:40.072668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:40.073419 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:40.080737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:40.081226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:40.081669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:40.082482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:40.082951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:40.083390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:40.227009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:40.236343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:40.237953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:40.239204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-13425d53-b5ac-4dc5-8979-a644a0fc97f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.170699 Aug 10 08:45:40.239769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 248/489] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:40 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:40.655618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:40.656223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:40.662624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:40.663103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:40.663550 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:40.664290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:40.664739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:40.665156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:40.727409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:40.734960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-619c375a-98f0-4e48-b152-9d17f3cfa89e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.084029 Aug 10 08:45:40.735730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 242/490] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:40 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:41.262917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:41.263532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:41.270382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:41.270922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:41.271356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:41.272078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:41.272531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:41.272986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:41.409417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:41.428419 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:41.429930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:41.431120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-61b42749-76f8-472d-9ae3-f00db6220829 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.172278 Aug 10 08:45:41.431694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 249/491] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:41 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:41.756413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:41.757660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:41.767629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:41.768465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:41.769225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:41.770135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:41.770811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:41.771423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:41.840396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:41.854417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-010efaa3-a5b6-4b01-a5a1-209da427167c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.096792 Aug 10 08:45:41.854417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 243/492] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:41 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:42.454086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:42.454719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:42.461827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:42.462308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:42.463067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:42.463840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:42.464344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:42.464921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:42.597046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:42.605870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:42.607397 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:42.608569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-53be6237-4d48-408d-9f83-487408800d06 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.158356 Aug 10 08:45:42.609319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 250/493] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:42 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:42.897836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:42.897836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:42.897836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:42.897836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:42.898536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:42.898536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:42.898536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:42.898536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:42.959021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:42.967329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-24fea090-407e-4909-bba9-0619d69bc857 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.101059 Aug 10 08:45:42.967970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 244/494] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:42 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:43.632880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:43.633507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:43.646892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:43.647385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:43.647852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:43.648558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:43.649307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:43.649798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:43.666097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:43.790914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:43.800004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:43.801783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:43.803025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6baf51ff-6c02-45f0-a78c-478ff612feb9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.174785 Aug 10 08:45:43.803794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 251/495] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:43 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:43.987719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:43.988325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:43.994631 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:43.995108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:43.995532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:43.996207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:43.996658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:43.997076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:44.066429 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:44.074198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1301973792", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993683958", "security_groups": [{"name": "tempest-secgroup-smoke-1632375263"}], "block_device_mapping_v2": [{"uuid": "4730382e-9e04-48c1-a31a-706fe1c2fd5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36df5925-02bb-4ea1-8602-8c8a2eea5405"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:44.075125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-db28a3f3-9692-415f-bc7e-30973f5d3dc9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.091153 Aug 10 08:45:44.075694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 245/496] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:43 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:44.192242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] validate_networks() for [('36df5925-02bb-4ea1-8602-8c8a2eea5405', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:45:44.567258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:45:44.567708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:45:44.568183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:45:44.568602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:45:44.569008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:45:44.578188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:44.578733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:44.579169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:44.579894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:44.580351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:44.580774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:44.597877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:45:44.602108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for user f1c7a90e90e5411f92eddd180ef9e27d and project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:45:44.659783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:45:44.661848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4730382e-9e04-48c1-a31a-706fe1c2fd5d',volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:45:44.825698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:44.826229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:44.832512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:44.836924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:44.836924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:44.836924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:44.836924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:44.837305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:44.984270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:44.987258 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:44.996041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:44.998354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:44.998804 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7339277c-e492-46af-ace9-807b5781cfac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.176963 Aug 10 08:45:44.999541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 246/497] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:44 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:45.096017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:45.096753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:45.102980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:45.109365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:45.109365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:45.109365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:45.109365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:45.109777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:45.120049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ca319af8-b976-4933-ad66-e2903592f8cf tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.049654 Aug 10 08:45:45.126768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 252/498] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:45:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:45:45.133202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-45f63d6d-7a34-496b-ab17-81caaa87b37a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:45.137996 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-45f63d6d-7a34-496b-ab17-81caaa87b37a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:45.187270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:45.195869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-edb59743-b4d3-4dfe-b4b3-30577dc5ba9e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.103833 Aug 10 08:45:45.197142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 247/499] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:45 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:45.211253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-45f63d6d-7a34-496b-ab17-81caaa87b37a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:45.233746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-45f63d6d-7a34-496b-ab17-81caaa87b37a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1094 microversion: 2.1 time: 0.105720 Aug 10 08:45:45.234342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 253/500] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:45 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:46.026869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:46.027576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:46.035468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:46.037222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:46.037222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:46.037222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:46.037618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:46.038079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:46.195276 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:46.204291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:46.205781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:46.206984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f797690e-966d-459c-b77c-d40f012077a7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.184987 Aug 10 08:45:46.207652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 248/501] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:46 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:46.217038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:46.219463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:46.229820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:46.230660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:46.231035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:46.231773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:46.232220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:46.232639 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:46.253177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d9ddbf13-580b-4514-8b7f-7b486bb74d6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:46.253823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d9ddbf13-580b-4514-8b7f-7b486bb74d6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:46.304896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:46.316040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d7ad06a4-1d94-417f-8bee-58e51520e9c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.102789 Aug 10 08:45:46.317012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 254/502] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:46 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:46.351215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d9ddbf13-580b-4514-8b7f-7b486bb74d6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:46.359291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d9ddbf13-580b-4514-8b7f-7b486bb74d6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1094 microversion: 2.1 time: 0.109898 Aug 10 08:45:46.359916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 249/503] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:46 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:47.231454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:47.232216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:47.238424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.238819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.239253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.239966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.240422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.240843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.337621 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:47.338545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:47.345058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.345642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.346167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.346926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.347447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.348157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.377160 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:47.394767 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:47.396268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:47.397991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7b7f9f5d-f81d-4ba7-8ce6-01b4b9a13b8f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.170065 Aug 10 08:45:47.398804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 255/504] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:47 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:47.402900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:47.403496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:47.409681 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.410159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.410787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.411468 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:47.414734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:47.415193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:47.415734 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:47.423221 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-50c8bcaa-2c4c-47aa-a3ab-483a174833cc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.089980 Aug 10 08:45:47.425027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 250/505] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:47 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:47.488263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:47.495906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e4d625b6-b0d3-41fe-8484-88b60b0ca5b3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.096387 Aug 10 08:45:47.496663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 256/506] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:47 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:48.421760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:48.422403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:48.428666 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.429149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.429586 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.430275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.430761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.431185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.444958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:48.445600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:48.452803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.461625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.461625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.461625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.461625 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.461994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.531073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:48.540276 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fb5af661-144b-4182-ba5d-d47f838d2a44 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.098988 Aug 10 08:45:48.540894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 257/507] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:48 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:48.546633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:48.547649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:48.553995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.554741 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.555288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.556052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:48.556667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:48.557167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:48.605785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:48.617168 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:48.617168 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:48.618047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ff54d542-4b5a-4409-a6c8-10bde8658bc3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.200255 Aug 10 08:45:48.630490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 251/508] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:48 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:48.630825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:48.640962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-25b40291-6a66-4fad-b90f-53d1149401fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.099023 Aug 10 08:45:48.641649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 258/509] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:48 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:49.561375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:49.561950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:49.568570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.569082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.569539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.570234 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.570720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.571178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.634860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:49.642340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bddf7a51-59f6-4a5f-90cb-f7bcd9391b39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.084968 Aug 10 08:45:49.642879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:49.643347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 252/510] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:49 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:49.643546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:49.650795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.653229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.653229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.653229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.653229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.653620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.662155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:49.662798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:49.669228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.669705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.670141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.670851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:49.671307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:49.671729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:49.733159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:49.740768 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-352af506-b6d0-4327-acdf-2e2a7aa648b8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.082275 Aug 10 08:45:49.741335 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 253/511] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:49 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:49.785084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:49.793986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:49.795506 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:49.796690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-451ae498-348f-497f-99f3-70395366073d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.157919 Aug 10 08:45:49.797256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 259/512] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:49 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:50.662948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:50.664087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:50.670541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.671018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.671445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.672120 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.672568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.672986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.732766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:50.741970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-125a1337-b996-4acd-a048-9b72735bb432 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.082814 Aug 10 08:45:50.744441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 254/513] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:50 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:50.761108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:50.761721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:50.768259 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.768742 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.769180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.769869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.770320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.770777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.820087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:50.820708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:50.826687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.827158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.827601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.829294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:50.829784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:50.830214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:50.830569 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:50.838679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0d2e4eeb-961a-4ef2-b4c1-1a6ff0a5c40b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.081921 Aug 10 08:45:50.839256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 260/514] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:50 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:50.967752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:50.975992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:50.977462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:50.978626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d6e8e2e5-2b93-469c-bdad-f17014b6f65b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.163175 Aug 10 08:45:50.979190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 255/515] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:50 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:51.763117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:51.763703 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:51.770002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:51.772339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:51.772339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:51.772339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:51.772339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:51.773295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:51.831779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:51.839772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9c86d3d7-d174-47c6-a9eb-ee118d1f0c3c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.080617 Aug 10 08:45:51.840337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 261/516] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:51 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:51.858902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:51.859530 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:51.865799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:51.866807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:51.867244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:51.867920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:51.868370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:51.868792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:51.926734 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:51.934727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1fbc0ea6-da11-4de2-8ab9-08c7d00bb130 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.079601 Aug 10 08:45:51.935284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 256/517] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:51 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:52.000661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:52.001264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:52.007858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.008331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.008757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:52.009428 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.009877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.010300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:52.138728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:52.147200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:52.148756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:52.149902 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b1e512cc-c526-4919-83cf-99a2223beabe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.153131 Aug 10 08:45:52.150509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 262/518] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:51 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:52.860197 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:52.860801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:52.867184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.867663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.868096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:52.868774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.869228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.869655 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:52.929181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:52.936524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-415e93dd-db2b-4bf3-8e43-1cad8345e58d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1245 microversion: 2.1 time: 0.080167 Aug 10 08:45:52.937089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 257/519] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:52 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:52.955513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:52.956163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:52.963247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.963735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.964173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:52.964861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:52.965323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:52.965751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:53.024718 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:53.032146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-93d806e0-2324-45cf-9128-b727924a535c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1144 microversion: 2.1 time: 0.080490 Aug 10 08:45:53.032713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 263/520] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:52 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:53.172641 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:53.173226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:53.179302 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:53.179779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:53.180213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:53.180894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:53.181350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:53.181782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:53.311770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:53.320730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:53.322229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:53.323409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-59bc5afb-574c-4d3b-b84d-3a7f117dc51f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.154706 Aug 10 08:45:53.323966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 258/521] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:53 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:53.957538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:53.958156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:53.965280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:53.970764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:53.970764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:53.970764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:53.970764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:53.971176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:54.053075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:54.053767 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:54.060277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:54.068317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:54.068317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:54.068317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:54.068317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:54.068688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:54.083379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:54.092078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-624a41be-46f2-489e-97e5-50eb662ab44e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1293 microversion: 2.1 time: 0.138602 Aug 10 08:45:54.092658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 264/522] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:53 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:54.130027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:54.138048 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-49702041-0278-4853-afbe-3cf100776aa6 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1192 microversion: 2.1 time: 0.088966 Aug 10 08:45:54.138635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 259/523] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:54 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:54.346715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:54.347229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:54.353102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:54.353574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:54.354001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:54.354697 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:54.355146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:54.355561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:54.482093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:54.490784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:54.492798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:54.494041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-63ef86b9-0dc3-4976-8f8f-39d30a99f3ed tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.151235 Aug 10 08:45:54.494968 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 265/524] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:54 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:55.114092 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:55.114733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:55.120702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.121184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.121617 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.122303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.122975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.123746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.161143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:55.161791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:55.164536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=4 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:55.170285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.171326 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.171326 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.171971 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.172422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.172840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.189361 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:55.197155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-eb0983d0-f626-4887-b609-7f57ec652ca8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1299 microversion: 2.1 time: 0.087675 Aug 10 08:45:55.199171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 260/525] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:55 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:55.235029 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=14 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:55.301926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:55.310050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2f2b87ff-f2ed-44d9-adf9-aebc16411b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1210 microversion: 2.1 time: 0.152947 Aug 10 08:45:55.310643 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 266/526] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:55 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1210 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:55.523902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:55.524524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:55.530979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.531571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.531963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.532645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:55.533093 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:55.533512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:55.662850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:55.671637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:55.673247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:55.674765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2271417a-c443-4af7-84a5-1d6da260d563 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.155363 Aug 10 08:45:55.675976 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 261/527] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:55 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:56.219598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:56.220314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:56.229042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.229610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.230346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.231086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.231760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.232394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.331160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:56.331696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:56.338315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.340146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.340146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.340146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.340828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.341251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.358718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=8 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:56.407961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:56.416725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e48d734e-86d8-4a1f-8ab7-4eb0913a60fb tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1210 microversion: 2.1 time: 0.089453 Aug 10 08:45:56.417299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 262/528] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:56 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:56.491655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:56.499227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-84fa57b7-fdec-4099-8071-6795971e4891 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.284111 Aug 10 08:45:56.499986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 267/529] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:56 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:56.699788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:56.701477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:56.707241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.707772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.708505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.709273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:56.710611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:56.711839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:56.864908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:56.873453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:56.875140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:56.876303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-16a2a0fb-65c9-45f0-871a-efba68e71efc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.180878 Aug 10 08:45:56.876864 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 263/530] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:56 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:45:57.438256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:57.438256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:57.444637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.445129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.445613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.446303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.446786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.447210 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.449754 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29c280c-b091-4dc5-afb8-89e58f6371de", "tag": "d740bb5d-ec07-49f1-974e-d3be4e5d30f6"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:57.466958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.466958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.466958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.483842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] Creating event network-changed:d740bb5d-ec07-49f1-974e-d3be4e5d30f6 for instance f29c280c-b091-4dc5-afb8-89e58f6371de on hv-cinder-78102 Aug 10 08:45:57.489153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-b0f2e175-5524-4d14-882d-4aae3a25b983 req-b50e9d4d-04e1-47c2-91b5-b7fa527875df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043063 Aug 10 08:45:57.489753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 264/531] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:45:57.521185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:57.521881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:57.529186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.529682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.530159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.531512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.532445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.532820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.537385 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:57.669952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:57.678405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e9786d6b-92b2-44c9-9b2f-2b9607bab3e1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.161393 Aug 10 08:45:57.679047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 265/532] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:57 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:45:57.899740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:57.900342 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:57.908060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.908544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.909061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:57.909755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:57.910211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:57.910663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:58.004365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:58.012471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1cfe4349-eca6-4e84-acaa-09d8b2dc6f88 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.578898 Aug 10 08:45:58.013359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 268/533] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:57 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:58.057670 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:58.066024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:58.067622 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:58.068834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-01b2d6b7-18b8-485d-82ca-c91e723cef70 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.172927 Aug 10 08:45:58.069969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 266/534] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:57 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:58.700214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:58.700827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:58.707273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:58.707762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:58.708194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:58.708877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:58.709331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:58.710263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:58.836184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:58.838348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:45:58.844030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ad5c0657-f166-43cf-a66e-a7a4ba328c5f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.147701 Aug 10 08:45:58.844594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 269/535] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:58 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:59.033243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:59.033853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:59.040487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.040905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.041344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.042029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.042510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.042939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.092020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:59.092622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:59.098920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.099513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.099945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.101709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.102162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.102601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.171266 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:59.178812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-655a7c69-f406-4daf-aae4-e73e03819bd1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.149572 Aug 10 08:45:59.179519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 267/536] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:59 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:45:59.229212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:59.237406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:59.238921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:45:59.240057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d20d8049-7112-42f7-874a-aa89623e70fb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.151961 Aug 10 08:45:59.240615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 270/537] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:45:59 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:45:59.249047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:59.251527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:59.257931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.258410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.258875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.259554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.260011 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.260458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.510642 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca6145f-1018-4b81-9e0c-9813a80b229f", "tag": "40ce47d6-49b6-4015-86c9-80332239af72"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:45:59.520093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.524090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.524090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.531890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] Creating event network-changed:40ce47d6-49b6-4015-86c9-80332239af72 for instance 2ca6145f-1018-4b81-9e0c-9813a80b229f on hv-cinder-78102 Aug 10 08:45:59.536990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-34753da6-34ec-4094-a548-934cae22bfa2 req-b6a26a79-58ae-49bb-9f4b-4fe920cc3942 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030515 Aug 10 08:45:59.537573 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 271/538] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:45:59.865525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:45:59.866864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:45:59.873390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.873879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.874308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:45:59.875022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:45:59.875478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:45:59.875899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:00.007320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:00.014807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f31a4dfa-b0f3-4bf5-9d28-9a83e2dccc42 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.153313 Aug 10 08:46:00.015376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 272/539] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:45:59 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:00.198940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:00.199549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:00.205283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:00.205766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:00.206199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:00.206917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:00.207370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:00.207794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:00.335775 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:00.343154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-07aca375-0747-4279-a3fc-e8946798b4a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.147925 Aug 10 08:46:00.343716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 273/540] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:00 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:00.348002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:00.348592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:00.354558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:00.355035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:00.355465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:00.356136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:00.356586 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:00.357005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:00.605158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:00.613539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:00.615062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:00.616215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0247c72b-9714-4146-ab32-ce78d3e94959 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.271591 Aug 10 08:46:00.616766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 274/541] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:00 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:01.035624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:01.036367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:01.042633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.043203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.043706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.044525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.044977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.045393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.179370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:01.186963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c8891d28-ad9c-4142-80c2-85b7692813e7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.155376 Aug 10 08:46:01.187534 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 275/542] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:01 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:01.217539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-826a085c-11be-47e5-a175-7cd4249fa58f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.972162 Aug 10 08:46:01.218653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 268/543] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:45:59 2022] POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments => generated 194 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:01.364261 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:01.364872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:01.371617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.372104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.372541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.373237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.373716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.374125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.504475 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:01.512003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-10fae703-eed5-4c54-a9bc-dbb58c0b5b97 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.151663 Aug 10 08:46:01.512510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 276/544] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:01 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:01.640901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:01.641673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:01.648591 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.649068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.649503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.650186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:01.650685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:01.651110 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:01.782305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:01.791598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:01.793086 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:01.794229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b92061a7-2341-44b6-8509-5cd86ea98235 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.158244 Aug 10 08:46:01.794821 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 269/545] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:01 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:02.208792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:02.209399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:02.212128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:02.216710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.217188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.217619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.218291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.218762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.219184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.345580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:02.352962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3e7b1915-80a0-4339-935f-019491109870 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.148023 Aug 10 08:46:02.353523 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 277/546] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:02 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:02.532490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:02.533018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:02.538982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.539464 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.539898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.540583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.541035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.541459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.666782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:02.674103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-efc1245d-139d-422d-a512-08942bb65f1d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.145817 Aug 10 08:46:02.674697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 270/547] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:02 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:02.816792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:02.817328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:02.823244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.823751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.824183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.824860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:02.825312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:02.825765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:02.951762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:02.960164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:02.961670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:02.962855 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-69ccbcd1-1592-4890-8c37-82a0aed4270f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.150095 Aug 10 08:46:02.963452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 278/548] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:02 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:03.374147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:03.374785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:03.380769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.381252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.381685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.382373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.382858 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.383280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.427546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "name": "network-vif-plugged", "status": "completed", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:03.439266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.439738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.440160 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.450886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] Creating event network-vif-plugged:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:46:03.455720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-3572b07a-92d3-4a44-bc92-6a12eadb9b2a req-34477918-c52f-4acd-bf93-8d7680e15704 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Aug 10 08:46:03.456622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 279/549] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:03.513466 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:03.520978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bbeb23a3-c231-4363-bce8-112ae367abef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.150835 Aug 10 08:46:03.521541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 271/550] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:03 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:03.695991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:03.696694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:03.702926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.703412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.703883 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.704571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.705028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.709096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.838311 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:03.845740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-23e7879d-4981-4ea7-ab7c-3161028febde tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.154457 Aug 10 08:46:03.846308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 280/551] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:03 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:03.986154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:03.986713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:03.993660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.997949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.997949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:03.997949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:03.997949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:03.998310 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:04.134767 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:04.143034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:04.144492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:04.145626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-632d292b-a2b3-400b-89d2-4fe2df889995 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.163545 Aug 10 08:46:04.146183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 272/552] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:03 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:46:04.543084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:04.543725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:04.550042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:04.550550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:04.550986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:04.551663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:04.552114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:04.552537 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:04.682406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:04.689710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8a813154-cb46-481b-bda6-bfeff68a9782 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.150519 Aug 10 08:46:04.690266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 281/553] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:04 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:04.866336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:04.866966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:04.872791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:04.873265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:04.873698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:04.874374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:04.874846 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:04.875263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:05.008478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:05.015911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b2fc91a2-596f-4022-84c0-d9870e19c88d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.153402 Aug 10 08:46:05.016472 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 273/554] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:04 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:05.168532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:05.169164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:05.175052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:05.175528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:05.175980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:05.176652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:05.177099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:05.177514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:05.309338 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:05.317811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:05.319839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:05.320997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7bd17439-f318-4084-af29-63770a5e0211 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.156366 Aug 10 08:46:05.321559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 282/555] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:05 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:05.710647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:05.713460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:05.720521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:05.721100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:05.721605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:05.722577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:05.723115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:05.723460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:05.857482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:05.864944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fff49725-3a19-4af6-81f7-3d353f97b209 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.158351 Aug 10 08:46:05.865521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 274/556] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:05 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:06.039268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:06.039805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:06.046125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.046635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.047063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:06.047737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.048183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.048607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:06.184152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:06.191716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-428fb797-f5a5-40b2-a05a-5cd127dacb86 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.156826 Aug 10 08:46:06.192286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 283/557] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:06 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:06.343880 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:06.344444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:06.351465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.351948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.352384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:06.353069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.353526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.353951 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:06.482085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:06.490502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:06.492026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:06.493180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a6c20db1-9057-4d19-a7c7-a2caa7a9c2c0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.153288 Aug 10 08:46:06.493738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 275/558] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:06 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:06.886817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:06.887448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:06.893413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.893892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.894321 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:06.895025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:06.895479 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:06.895903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.024604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:07.032165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b4b93f3a-ee35-4deb-99ff-027e73288612 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.149186 Aug 10 08:46:07.032727 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 284/559] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:06 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:07.211922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:07.212650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:07.218599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:07.219076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:07.219503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.220176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:07.220847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:07.221278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.345087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:07.353540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e2e47d38-9a9c-487d-a348-df9a6e0e001a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.145347 Aug 10 08:46:07.354115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 276/560] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:07 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:07.516373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:07.520758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:07.523509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:07.523992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:07.524501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.525165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:07.525644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:07.526069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.610038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29c280c-b091-4dc5-afb8-89e58f6371de", "name": "network-vif-plugged", "status": "completed", "tag": "d740bb5d-ec07-49f1-974e-d3be4e5d30f6"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:07.622498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:07.623130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:07.623688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:07.638770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] Creating event network-vif-plugged:d740bb5d-ec07-49f1-974e-d3be4e5d30f6 for instance f29c280c-b091-4dc5-afb8-89e58f6371de on hv-cinder-78102 Aug 10 08:46:07.640801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-3f9bc39d-2b08-47f9-8513-117308d33c4b req-60e7bb58-19fe-4406-aedf-82eae33465a2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Aug 10 08:46:07.641871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 277/561] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:07.662319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:07.671427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:07.672930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:07.674215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-80942375-94e5-4deb-b826-fd50547815e3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.161867 Aug 10 08:46:07.674819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 285/562] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:07 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:08.053491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:08.054689 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:08.060822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.061697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.061697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.062433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.062906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.063325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.195475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:08.202896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bc0d240c-42f7-4b36-a8aa-e22a37baa72d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.153687 Aug 10 08:46:08.203787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 278/563] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:08 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:08.375142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:08.375266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:08.381113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.381591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.382056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.382833 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.383289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.383713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.545864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:08.553786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4df5eb31-f7c5-480d-aa33-855fef2e4387 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.183086 Aug 10 08:46:08.554360 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 286/564] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:08 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:08.697060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:08.697656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:08.703970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.704447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.704875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.705548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:08.705996 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:08.706410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:08.836071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:08.844690 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:08.846218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:08.852072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3b9d831f-bd7c-4da5-b357-65b45278b1c5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1808 microversion: 2.20 time: 0.154217 Aug 10 08:46:08.852072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 279/565] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:08 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:09.223468 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:09.224126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:09.230582 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.231137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.231662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:09.232177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.232634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.233059 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:09.363695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:09.366010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:09.371852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-13bc4d28-11c7-42f5-847d-880525ccdff1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.152190 Aug 10 08:46:09.372398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 287/566] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:09 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:09.575060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:09.575658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:09.581532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.582006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.582438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:09.583155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.583678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.584081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:09.714778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:09.722273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b732a041-cc16-4845-849c-1e6bde6d8def tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.151063 Aug 10 08:46:09.722863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 280/567] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:09 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:09.871608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:09.872234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:09.878735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.879225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.879650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:09.880331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:09.880783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:09.881203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:10.013708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:10.022045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:10.024169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:10.025326 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7c8e79b6-4983-45d3-93a1-bf828a3ec3f5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1795 microversion: 2.20 time: 0.158033 Aug 10 08:46:10.025885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 288/568] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:46:09 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:46:10.392502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:10.393022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:10.399588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:10.400066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:10.400504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:10.401186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:10.401640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:10.402066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:10.406260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:10.527718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:10.535414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2f15eee1-1118-4b92-abb8-6151809645ae tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1366 microversion: 2.1 time: 0.146877 Aug 10 08:46:10.535970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 281/569] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:10 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:10.743687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:10.744329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:10.750263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:10.750777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:10.751214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:10.751901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:10.752363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:10.752793 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:10.885090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:10.892462 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-94e09dab-08aa-46e2-9bd1-c782eb8482e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.153221 Aug 10 08:46:10.893034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 289/570] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:10 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:11.556648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:11.557257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:11.559573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=84 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:11.564172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.564657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.565097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:11.565783 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.566239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.566762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:11.698038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:11.705438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b4bbf06c-3159-48a0-bc14-670bd93917c2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1557 microversion: 2.1 time: 0.153225 Aug 10 08:46:11.705997 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 282/571] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:11 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:11.725890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:11.726307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:11.732360 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.732833 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.733260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:11.733937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.734386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.734827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:11.810085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-796127a8-e522-495b-9a0c-7b8d7fd7ec52 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088737 Aug 10 08:46:11.810707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 290/572] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:46:11 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:11.913712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:11.914353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:11.920488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.921049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.921557 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:11.922341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:11.922886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:11.923372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:12.138881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:12.146284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2f06060b-f998-4f39-b8c6-724ace51c7a7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.236896 Aug 10 08:46:12.146886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 283/573] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:11 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:13.053180 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29c280c-b091-4dc5-afb8-89e58f6371de", "tag": "d740bb5d-ec07-49f1-974e-d3be4e5d30f6"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:13.064083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:13.064563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:13.064997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:13.076548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] Creating event network-changed:d740bb5d-ec07-49f1-974e-d3be4e5d30f6 for instance f29c280c-b091-4dc5-afb8-89e58f6371de on hv-cinder-78102 Aug 10 08:46:13.081646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-b37b93b5-d713-43e8-80f5-b8ae1b75834c req-98b6a412-88d7-4777-8196-ebdebd7497b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034015 Aug 10 08:46:13.082249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 291/574] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:13.168066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:13.168667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:13.175097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:13.175576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:13.176025 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:13.176706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:13.177154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:13.177569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:13.311173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:13.318433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-79030c57-54eb-443e-b634-944510b2fbc5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.154259 Aug 10 08:46:13.319020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 284/575] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:13 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:14.342150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:14.343159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:14.349864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:14.350390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:14.351015 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:14.351880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:14.352336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:14.352801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:14.490432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:14.498347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2ce20c5b-9a14-4926-adc0-1e72696bd432 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.161942 Aug 10 08:46:14.498942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 292/576] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:14 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:15.110892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:15.113163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:15.120155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.120636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.121072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.121759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.122216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.122682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.146041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'flavor' on Instance uuid afbe8c40-e90c-4e86-aa84-a0570bd3253b {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:46:15.455552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a3b143f0-b1bc-446a-b761-c1f6220b8054 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/action" status: 200 len: 32 microversion: 2.1 time: 0.348581 Aug 10 08:46:15.456097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 285/577] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:46:15 2022] POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:46:15.465990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:15.466628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:15.473140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.473637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.474300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.474785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.475254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.476257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.519749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:15.520448 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:15.527320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.527814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.528247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.529191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:15.529645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:15.530072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:15.605451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:15.613964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-198f31d9-10bc-4188-b96c-ef18439529ae tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.151715 Aug 10 08:46:15.614639 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 293/578] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:15 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:15.678775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:15.686169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a40a43b8-0e1b-4b6c-9769-851e98156374 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.170605 Aug 10 08:46:15.686763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 286/579] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:15 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:16.321406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca6145f-1018-4b81-9e0c-9813a80b229f", "name": "network-vif-plugged", "status": "completed", "tag": "40ce47d6-49b6-4015-86c9-80332239af72"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:16.332057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:16.332528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:16.332951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:16.343619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] Creating event network-vif-plugged:40ce47d6-49b6-4015-86c9-80332239af72 for instance 2ca6145f-1018-4b81-9e0c-9813a80b229f on hv-cinder-78102 Aug 10 08:46:16.348825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-20566876-3505-4468-935c-1c903f65773e req-e2e6b9a2-6b83-42a2-8d98-eaca9b1a48bf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031380 Aug 10 08:46:16.352115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 294/580] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:16.634096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:16.634696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:16.641144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:16.641623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:16.642060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:16.642772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:16.643231 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:16.643674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:16.708057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:16.709526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:16.718384 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:16.718945 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:16.719398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:16.720096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:16.720553 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:16.721097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:16.777809 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:16.785908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b2b6e457-2e44-4a29-bfcc-e8b200c0f602 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.155758 Aug 10 08:46:16.786499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 287/581] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:16 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:16.856332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:16.863646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-34743b75-9eb1-4867-84c7-6a44c16d8013 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.159793 Aug 10 08:46:16.864209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 295/582] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:16 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:17.807991 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:17.808549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:17.815015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:17.815493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:17.815933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:17.816611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:17.817060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:17.817480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:17.884826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:17.885433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:17.891804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:17.892286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:17.892725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:17.893412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:17.893868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:17.894321 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:17.946923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:17.955146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b9f3e309-1b4a-4413-99c3-ef3d6cbdb9b5 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.151208 Aug 10 08:46:17.956045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 288/583] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:17 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:18.025335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:18.032974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e58c36ad-4350-4c3a-b921-1a5b1a455f7f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.152469 Aug 10 08:46:18.033545 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 296/584] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:17 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:18.977255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:18.977854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:18.984303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:18.984777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:18.985210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:18.985886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:18.986336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:18.986785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:19.054297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:19.054925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:19.060914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:19.061390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:19.061821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:19.062540 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:19.063209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:19.063630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:19.118167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:19.126128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7e7badba-67ae-449b-b95a-4239adb200dc tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.153364 Aug 10 08:46:19.126721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 289/585] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:18 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:19.194899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:19.202145 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ee6edf0d-7ab7-4cf5-94e3-725a717535c8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1266 microversion: 2.1 time: 0.151693 Aug 10 08:46:19.202753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 297/586] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:19 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:20.146395 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:20.147024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:20.154432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.154952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.155420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.156105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.156592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.157015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.222514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:20.223069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:20.229355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.229832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.230260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.230961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.231410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.231824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.289861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:20.297812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b9a6efeb-6aaf-497c-bb46-a7f48f44ef04 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.155205 Aug 10 08:46:20.298379 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 290/587] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:20 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:20.361978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:20.369978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6d917b6e-0796-4e0c-affb-32d6f1687fef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1453 microversion: 2.1 time: 0.151393 Aug 10 08:46:20.370567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 298/588] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:20 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:20.390270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:20.390920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:20.396798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.397280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.398211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.398957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:20.399422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:20.399845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:20.531435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:20.539432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3b9167bf-60eb-400a-ba7d-c3667caf4cd7 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1453 microversion: 2.1 time: 0.153079 Aug 10 08:46:20.540009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 291/589] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:20 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:21.319390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:21.319949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:21.326302 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:21.326895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:21.327339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:21.329020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:21.329473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:21.329896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:21.463394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:21.471384 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-15c5d33f-82e0-48ce-84de-cfb39e44c8e3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.155970 Aug 10 08:46:21.471956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 299/590] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:21 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:22.435179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca6145f-1018-4b81-9e0c-9813a80b229f", "tag": "40ce47d6-49b6-4015-86c9-80332239af72"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:22.445019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:22.445488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:22.445911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:22.456926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] Creating event network-changed:40ce47d6-49b6-4015-86c9-80332239af72 for instance 2ca6145f-1018-4b81-9e0c-9813a80b229f on hv-cinder-78102 Aug 10 08:46:22.461934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-ebce1b7d-daa9-420f-924e-99e8c10c4fba req-bbc38a62-47e0-4d28-80c0-81cfc7515a45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030437 Aug 10 08:46:22.462556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 292/591] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:22.493784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:22.494460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:22.500949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:22.501429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:22.501860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:22.502568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:22.503042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:22.503521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:22.708474 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:22.720147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ea83df2e-c88d-4456-911e-25f370fed1a4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.230915 Aug 10 08:46:22.731481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 300/592] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:22 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:23.743040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:23.743752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:23.749778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:23.750253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:23.750777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:23.751455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:23.751905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:23.752322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:23.879007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:23.886923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d895ebac-1238-4872-a303-061ba277b100 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.149216 Aug 10 08:46:23.887482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 293/593] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:23 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:24.907421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:24.907991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:24.915414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:24.915897 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:24.916353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:24.917042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:24.917497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:24.917921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:25.055663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:25.063520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3dd64166-ec2a-4aa1-93c0-fe64fd3a5ad3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.160274 Aug 10 08:46:25.067403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 301/594] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:24 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:26.084436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:26.085040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:26.091452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:26.091932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:26.092369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:26.093052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:26.093507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:26.093932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:26.221165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:26.229507 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-44fd0e33-f08f-4662-8ce6-56e64cd13e23 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.148906 Aug 10 08:46:26.230076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 294/595] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:26 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:27.251146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:27.251666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:27.258578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:27.259054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:27.259481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:27.260155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:27.260605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:27.261019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:27.386888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:27.394667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3327c147-50a2-46ce-87ce-ecae89f2db10 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.147386 Aug 10 08:46:27.395231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 302/596] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:27 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:28.415978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:28.416612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:28.423151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:28.423628 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:28.424069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:28.424753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:28.425211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:28.425632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:28.556532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:28.564459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d2f10fdd-a573-4fcc-8226-8e5bb83302ab tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.152337 Aug 10 08:46:28.565024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 295/597] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:28 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:29.076114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:29.076684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:29.083134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:29.083615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:29.084052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:29.084731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:29.085810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:29.086234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:29.206891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lazy-loading 'services' on Instance uuid ecd54a38-d75c-4105-80d5-02e459816b82 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:46:29.463349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-30b007ce-2f7d-49fa-97b3-024b4a89a9c9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments/902f0126-0e2c-4303-b9dd-30f8288870d4" status: 202 len: 0 microversion: 2.1 time: 0.390942 Aug 10 08:46:29.463868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 303/598] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:46:29 2022] DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments/902f0126-0e2c-4303-b9dd-30f8288870d4 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:46:29.586238 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:29.586908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:29.593412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:29.593902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:29.594342 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:29.595077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:29.595541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:29.595969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:29.610990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:29.774560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:29.782328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e2eb4ba9-6c00-4e0c-ac5f-1a2f55ec59a8 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.199897 Aug 10 08:46:29.782916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 296/599] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:29 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:30.805037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:30.805741 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:30.811962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:30.812450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:30.812956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:30.813602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:30.814170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:30.814634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:30.948188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:30.956197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e2f73907-caad-4b2f-a96a-de343c227d57 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.156476 Aug 10 08:46:30.962108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 304/600] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:30 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:31.633763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:31.640238 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:31.640716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:31.641149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:31.668494 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Going to try to stop instance {{(pid=124809) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 08:46:31.814726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-db36c2e7-a532-4ccd-8d1f-c268f2afba61 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action" status: 202 len: 0 microversion: 2.1 time: 0.185189 Aug 10 08:46:31.815255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 297/601] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:46:31 2022] POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:46:31.824099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:31.824712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:31.831154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:31.831637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:31.832069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:31.832807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:31.833258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:31.833679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:31.848476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:31.978310 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:31.979352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:31.985752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:31.986319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:31.986856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:31.987765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:31.988295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:31.988804 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:32.015963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:32.023921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a22d4319-11a0-41a3-971f-758bb7711446 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.204403 Aug 10 08:46:32.024497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 305/602] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:31 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:32.121956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:32.129785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-debbe010-c98f-4458-a9b4-d91bdef10f76 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.156395 Aug 10 08:46:32.130343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 298/603] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:31 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:33.045312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:33.045921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:33.047957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=58 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:33.052572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:33.053054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:33.053493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:33.054822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:33.055277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:33.055700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:33.151287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:33.151902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:33.158515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:33.159005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:33.159445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:33.160138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:33.160602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:33.161033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:33.180521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:33.187860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-53175fca-04f0-46e6-aff0-952da216337f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.146408 Aug 10 08:46:33.188426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 306/604] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:33 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:33.287522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:33.295964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f3b37a5b-7fa3-4572-86b1-bc708e19edc4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.149008 Aug 10 08:46:33.296521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 299/605] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:33 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:34.208052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:34.208623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:34.214913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:34.215391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:34.215919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:34.216614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:34.217063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:34.217480 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:34.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:34.317778 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:34.324587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:34.325082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:34.325518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:34.326210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:34.326692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:34.327118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:34.378854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:34.386350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7dc102a0-af72-415e-8eec-0342c8e91466 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.182175 Aug 10 08:46:34.386948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 307/606] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:34 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:34.455014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:34.462899 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b51ba849-7c6d-4b27-861f-e3b4106165b7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.149546 Aug 10 08:46:34.463397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 300/607] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:34 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:35.407779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:35.408418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:35.415439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:35.415919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:35.416353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:35.417030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:35.417481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:35.417901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:35.484232 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:35.484828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:35.491121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:35.491629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:35.492060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:35.492997 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:35.493175 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:35.493593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:35.547865 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:35.555633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7af1a092-b408-4ac6-9c00-1742f6451f62 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.151615 Aug 10 08:46:35.556221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:35 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:35.854846 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:35.862748 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-97484e93-df59-43de-afdc-4029290a06a7 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1737 microversion: 2.1 time: 0.382828 Aug 10 08:46:35.863311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 301/609] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:35 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1737 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:36.576598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:36.577229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:36.583616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:36.584093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:36.584525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:36.585201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:36.585652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:36.586079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:36.712385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:36.719898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e6f5057b-e5ca-48cc-b94a-86b084608527 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.147186 Aug 10 08:46:36.720462 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 309/610] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:36 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:36.883763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:36.884296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:36.890691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:36.894922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:36.894922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:36.894922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:36.894922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:36.895296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.027898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:37.036012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6740a728-8bd9-442b-b3b2-c88177cef26e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1717 microversion: 2.1 time: 0.156193 Aug 10 08:46:37.036599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 302/611] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:36 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:37.141411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:37.141838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:37.148160 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.148641 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.149077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.149759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.150213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.150659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.228813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] HTTP exception thrown: Cannot 'detach_volume' instance afbe8c40-e90c-4e86-aa84-a0570bd3253b while it is in vm_state rescued Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Request method failure captured: Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments/bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f HTTP/1.1 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829I0s8OLLd7kgYfQFsl1J1623noD67FD3sKctS7l0sDbxkw2bLNMkm4Gl7WZJOLtHfWtrg77e-tt47ew0CT7Gj2wgE5jDAaqLZzWzK8_vEjzgsw_k2syerqtpJMzWGToUkn_ddLyOOz7AgqW3rAA5u_P7tMgqIgyNeptsV1BWQzvs4 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:46:37.230408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5c6694dd460a467a986bcaa0e5e000a9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: d28b7a7b2e0143cf9ee6e761eb7fb281 Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:46:37.232035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Cannot 'detach_volume' instance afbe8c40-e90c-4e86-aa84-a0570bd3253b while it is in vm_state rescued Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'server_id': 'afbe8c40-e90c-4e86-aa84-a0570bd3253b', 'id': 'bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f'} Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:46:37.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance afbe8c40-e90c-4e86-aa84-a0570bd3253b while it is in vm_state rescued Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance afbe8c40-e90c-4e86-aa84-a0570bd3253b while it is in vm_state rescued Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:46:37.234659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Returning 409 to user: Cannot 'detach_volume' instance afbe8c40-e90c-4e86-aa84-a0570bd3253b while it is in vm_state rescued {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:46:37.236254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5dae6f59-cd8c-4ce0-ad4f-67441914022a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments/bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f" status: 409 len: 152 microversion: 2.1 time: 0.094446 Aug 10 08:46:37.236254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 310/612] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:46:37 2022] DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments/bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 08:46:37.240547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:37.241076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:37.246925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.247401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.247836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.248519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.248972 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.249394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.443725 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a746e4a0-e47d-44b1-a90a-5a990cf14250 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/action" status: 202 len: 0 microversion: 2.1 time: 0.206694 Aug 10 08:46:37.444890 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 303/613] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:46:37 2022] POST /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:46:37.453214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:37.453837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:37.461444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.462029 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.462507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.463195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.463646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.464061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.590212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:37.597958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6e17919d-6b44-4a1e-819b-1e9ccd753c5e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1725 microversion: 2.1 time: 0.148765 Aug 10 08:46:37.598531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 311/614] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:37 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:37.742235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:37.742869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:37.748985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.749469 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.749903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.750620 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:37.751071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:37.751492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:37.885936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:37.893929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-10e49f92-5d56-4d6d-a4b0-04f739df5141 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.156523 Aug 10 08:46:37.894512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 304/615] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:37 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:38.619634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:38.620239 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:38.626560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:38.627046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:38.627476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:38.628166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:38.628619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:38.629043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:38.759636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:38.767486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-56ed9c0c-626f-45b1-91c8-4b104e303e92 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1725 microversion: 2.1 time: 0.151710 Aug 10 08:46:38.768045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 312/616] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:38 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:38.915020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:38.915529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:38.922136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:38.922826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:38.923274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:38.924049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:38.924504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:38.924923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:39.049930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:39.057513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c892c342-6175-48c1-97ee-7b0ea3b01b85 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.146339 Aug 10 08:46:39.058085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 305/617] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:38 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:39.789424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:39.789955 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:39.796614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:39.797094 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:39.797525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:39.798244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:39.798726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:39.799148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:39.924969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:39.932899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c6403088-d3d8-42af-b6f5-1dade2838527 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1725 microversion: 2.1 time: 0.147321 Aug 10 08:46:39.933461 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 313/618] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:39 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:40.078793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:40.079329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:40.086221 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:40.086735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:40.087166 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:40.087850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:40.088312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:40.088735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:40.218366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:40.225300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-20a4ee6e-63ea-42b8-98bb-b948867706d3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.150096 Aug 10 08:46:40.225871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 306/619] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:40 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:40.953060 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:40.953670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:40.960063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:40.960546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:40.960982 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:40.961665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:40.962121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:40.962573 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:41.167294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:41.175042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-66927ac8-414b-4a25-8aed-fe98d6c1eccb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1725 microversion: 2.1 time: 0.225818 Aug 10 08:46:41.175613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 314/620] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:40 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:41.245581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:41.246184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:41.252451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:41.252938 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:41.253344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:41.254014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:41.254486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:41.254901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:41.384648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:41.392256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-190adc59-972b-43ce-bd50-4cd42a611c6f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.151053 Aug 10 08:46:41.392858 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 307/621] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:41 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:42.197250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:42.197859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:42.204158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.204634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.205066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.205750 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.206198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.206650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.363711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:42.372038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dd859059-6200-432e-a890-3fb095067e3d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1731 microversion: 2.1 time: 0.179427 Aug 10 08:46:42.372597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 315/622] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:42 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:42.392536 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:42.393046 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:42.395425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=52 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:42.399913 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.400387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.400815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.401489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.401936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.402353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.480095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-62e57194-2c61-46ec-8cbf-af41d6098763 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091259 Aug 10 08:46:42.480696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 308/623] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:46:42 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:46:42.514848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:42.515533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:42.522686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.523278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.523858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.524610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:42.525130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:42.525617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:42.656949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:42.665338 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5b5b1d8f-1871-47c1-80f2-70ea80cdff60 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.255014 Aug 10 08:46:42.665916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 316/624] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:42 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:43.380756 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:43.393884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:43.394512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:43.394922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:43.406813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] Creating event network-changed:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:46:43.411867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-78f4243d-0033-4ac9-9c68-d993d9f36c9c req-18a272c9-03a7-475a-976c-eed0c254dbeb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035594 Aug 10 08:46:43.412697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 309/625] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:43.685801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:43.686416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:43.693497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:43.693980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:43.695236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:43.696219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:43.696903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:43.697551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:43.910787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:43.918928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e0a316b7-25cf-4176-b731-58e97ada4700 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.236945 Aug 10 08:46:43.919585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 317/626] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:43 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:44.942042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:44.942895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:44.949486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:44.949965 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:44.950413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:44.961706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:44.961706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:44.961706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:45.078667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:45.086807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7bffb2af-b5c4-4430-8ce1-bb5276c7685b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.149760 Aug 10 08:46:45.087379 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 310/627] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:44 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:45.425792 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:45.436182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:45.436649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:45.437073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:45.448312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] Creating event network-changed:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:46:45.453123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-a3490088-46e6-4614-8b7f-eef6a9240b9b req-4ac04081-2009-420a-b2c2-12e53586ff3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 Aug 10 08:46:45.453670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 318/628] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:46:46.107686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:46.108287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:46.114723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:46.115198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:46.115626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:46.116300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:46.116751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:46.117166 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:46.251434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:46.258882 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a899cccb-438d-4094-95dd-50cd162ad1a1 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.155002 Aug 10 08:46:46.259442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 311/629] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:46 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:46.980127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:46.982399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:46.988504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:46.988981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:46.989410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:46.990089 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:46.990575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:46.990997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:47.175114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b7d4dffc-da72-4863-bf31-7b7aad9ef3ce tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action" status: 202 len: 0 microversion: 2.1 time: 0.199553 Aug 10 08:46:47.175796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 319/630] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:46:46 2022] POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:46:47.184036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:47.184645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:47.191156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:47.191636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:47.192072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:47.192781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:47.193340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:47.193790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:47.198388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:47.280244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:47.280942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:47.287376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:47.287861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:47.288301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:47.289033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:47.289492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:47.289919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:47.344384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:47.354543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4d3d0847-efa0-41ff-a22d-86efe860eba5 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1750 microversion: 2.1 time: 0.174080 Aug 10 08:46:47.355721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 312/631] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:47 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:47.509911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:47.517437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-efe09f8d-f1b6-405c-9b2c-7b8c60aacecd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.241748 Aug 10 08:46:47.518007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 320/632] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:47 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:48.381311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:48.381914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:48.389018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:48.389500 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:48.389939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:48.390662 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:48.391121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:48.391551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:48.530350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:48.538533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b1a261cf-63cb-4f2b-945d-13890df4f80e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.161544 Aug 10 08:46:48.538951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:48.540057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:48.546436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:48.546938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:48.547367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:48.548042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:48.548489 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:48.548903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:48.550799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 313/633] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:48 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:48.675346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:48.677723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:46:48.684163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ed572923-3dea-4098-9218-ba716ee449b9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.148996 Aug 10 08:46:48.684726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 321/634] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:48 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:49.561226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:49.561829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:49.568253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:49.568733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:49.569168 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:49.569854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:49.570308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:49.570759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:49.705257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:49.706571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:49.713374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:49.713860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:49.714292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:49.714414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:49.715013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:49.715477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:49.715924 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:49.722363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7c83df28-c1c3-4eda-9979-b2f142125b99 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.164963 Aug 10 08:46:49.722959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 314/635] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:49 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:49.845410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:49.852692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-515acda9-488c-455b-8b3c-8c45ba357f83 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.151747 Aug 10 08:46:49.853248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 322/636] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:49 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:50.743580 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:50.744244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:50.750869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:50.751344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:50.751800 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:50.752531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:50.752981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:50.753400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:50.873159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:50.873741 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:50.880204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:50.880687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:50.881119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:50.881795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:50.882252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:50.882698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:50.892182 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:50.900721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6e86b755-e0eb-49a4-bdd9-55f19faf5705 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.160961 Aug 10 08:46:50.901285 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 315/637] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:50 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:51.009681 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:51.017048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3dbe2a66-8d74-4948-b4b3-2e11f50d6ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.147716 Aug 10 08:46:51.017606 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 323/638] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:50 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:51.921509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:51.922038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:51.928406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:51.928881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:51.929313 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:51.929990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:51.930434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:51.930883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:52.038512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:52.040256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:52.046733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:52.047225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:52.047661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:52.048358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:52.048815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:52.049242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:52.088054 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:52.096638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3b3d19e8-5b98-4278-8d31-043c69a0451c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.178695 Aug 10 08:46:52.096857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 316/639] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:51 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:52.177660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:52.185127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-39524954-6e95-40a4-92d4-bb5cd05cc391 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1678 microversion: 2.1 time: 0.150398 Aug 10 08:46:52.185696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 324/640] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:52 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:53.119209 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:53.119807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:53.126213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.126715 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.127147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.127820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.128267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.128681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.206921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:53.207535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:53.213698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.214172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.214638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.215314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.215762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.216177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.266417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:53.276318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-07b58c48-e814-48ba-a388-920e270bad73 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.161533 Aug 10 08:46:53.277118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 317/641] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:53 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:53.347144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:53.355241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-968488f0-f0b6-488c-bcea-ac655308098f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1655 microversion: 2.1 time: 0.152245 Aug 10 08:46:53.355793 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 325/642] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:53 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:53.375151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:46:53.381045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.381523 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.381956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.403840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Going to try to start instance {{(pid=124809) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 08:46:53.620380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b1a73985-50d3-40e9-8a7a-8fbc5795aef2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action" status: 202 len: 0 microversion: 2.1 time: 0.248816 Aug 10 08:46:53.621015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 318/643] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:46:53 2022] POST /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:46:53.629104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:53.629705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:53.635579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.636056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.636480 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.637159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:53.637607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:53.638017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:53.769310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:53.777502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-79e3bf39-ae37-4ab3-b51d-3eb2bef4d3f6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1664 microversion: 2.1 time: 0.152301 Aug 10 08:46:53.786831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 326/644] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:53 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:54.298692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:54.299380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:54.305632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:54.306114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:54.306576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:54.307261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:54.307843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:54.308268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:54.450146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:54.457996 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b03297d3-9d2d-4c47-82ad-faa548c5db54 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.163992 Aug 10 08:46:54.458584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 319/645] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:54 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:54.798800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:54.799413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:54.806188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:54.806708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:54.807144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:54.807830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:54.808287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:54.808710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:54.950345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:54.958324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0f750e2d-8a29-49c6-afe8-f8043f0d3d03 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1664 microversion: 2.1 time: 0.163340 Aug 10 08:46:54.960481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 327/646] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:54 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:55.200038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:46:55.200216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 08:46:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 08:46:55.479662 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:55.480292 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:55.486674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:55.487155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:55.487590 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:55.488296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:55.488749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:55.489172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:55.637808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:55.645851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-14595954-acbf-4568-b9b4-508bce08ba8e tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.171024 Aug 10 08:46:55.646421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 320/647] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:55 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:55.979499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:55.980113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:55.986480 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:55.986973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:55.987411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:55.988100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:55.988558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:55.988987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:56.114527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:56.121863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d0415828-8650-4bb6-a521-9638eb630004 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1668 microversion: 2.1 time: 0.146223 Aug 10 08:46:56.122423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 328/648] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:55 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1668 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:46:56.668239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:56.668844 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:56.675300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:56.675779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:56.676214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:56.676899 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:56.677347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:56.677766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:56.815636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:56.823551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9ddf01db-b2aa-49fc-a83e-d4bbef21f68b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.159582 Aug 10 08:46:56.824093 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 321/649] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:56 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:57.843664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:57.844264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:57.850637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:57.851110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:57.851539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:57.852213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:57.852666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:57.853080 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:57.994427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:58.002458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0c957efa-9780-471f-9cb1-03da5d15029c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.162588 Aug 10 08:46:58.003032 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 329/650] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:57 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:46:59.024642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:46:59.025150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:46:59.032226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:59.032701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:59.033132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:59.033806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:46:59.034256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:46:59.034698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:46:59.178769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:46:59.186774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-76a783b4-1d76-437a-be5c-d1a5bff18074 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1755 microversion: 2.1 time: 0.166633 Aug 10 08:46:59.187331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 322/651] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:46:59 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:00.208193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:00.208746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:00.215861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:00.216332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:00.216761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:00.217438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:00.217896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:00.218304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:00.356372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:00.364149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-64d27120-a510-4291-aab7-b6f10bf49292 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1758 microversion: 2.1 time: 0.159944 Aug 10 08:47:00.364716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 330/652] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:00 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:26.816701 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=29 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:26.817444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:26.916614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:26.917112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:26.923470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:26.923948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:26.924381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:26.925067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:26.925522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:26.925945 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:26.957368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-739dad37-dd3b-4f49-9598-8998e70ed599 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments/5aaae1ff-1156-48bf-adfa-6610f193adaa" status: 200 len: 194 microversion: 2.20 time: 0.145434 Aug 10 08:47:26.957928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 323/653] 10.222.0.45 () {60 vars in 1454 bytes} [Wed Aug 10 08:47:26 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments/5aaae1ff-1156-48bf-adfa-6610f193adaa => generated 194 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 08:47:27.022938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:27.023443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:27.025639 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=49 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:27.026282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=55 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:27.031178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:27.031656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:27.032089 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:27.032772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:27.033226 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:27.033782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:27.112836 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lazy-loading 'services' on Instance uuid 4806864d-f9df-4b0b-9b3d-6a0e2e960fda {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:47:27.330361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b81aeb54-c562-4d22-8e1b-4252cde7464b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments/5aaae1ff-1156-48bf-adfa-6610f193adaa" status: 202 len: 0 microversion: 2.20 time: 0.311093 Aug 10 08:47:27.330915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 331/654] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 10 08:47:27 2022] DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments/5aaae1ff-1156-48bf-adfa-6610f193adaa => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:47:27.339460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:27.342384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:27.348451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:27.348934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:27.349376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:27.350229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:27.350724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:27.351153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:27.380002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6af2758e-e06d-4630-b0ec-47c33054fbee tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Aug 10 08:47:27.380571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 324/655] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 08:47:27 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:47:28.393665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:28.396004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:28.402270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:28.402774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:28.403201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:28.404400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:28.404844 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:28.405254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:28.433620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b75808eb-ddf8-4a20-82d6-114bde2e5c96 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044853 Aug 10 08:47:28.434169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 332/656] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 08:47:28 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:47:29.445342 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:29.453162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:29.454805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.455317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.455770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:29.456448 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.456893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.457311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:29.486403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c9b58951-b868-4a10-b47e-85f1a60796e5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045060 Aug 10 08:47:29.486995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 325/657] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 08:47:29 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:29.550894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:29.551375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:29.557740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.558224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.558694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:29.559374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.559825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.560263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:29.586941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:47:29.937085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5452c9d4-c780-4afe-ab56-e3e393a018ac tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 204 len: 0 microversion: 2.20 time: 0.389774 Aug 10 08:47:29.937683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 333/658] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 08:47:29 2022] DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 08:47:29.946080 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:29.946711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:29.952555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.953030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.953461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:29.954136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:29.954644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:29.955064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:30.081869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:30.089614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:30.091138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:30.092834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-72cdfdf2-20dd-4eac-ac36-673ddd639af1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.150249 Aug 10 08:47:30.093385 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 326/659] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:29 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:31.116005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:31.116704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:31.123005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:31.124100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:31.124536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:31.125216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:31.125665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:31.126082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:31.253630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:31.260888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:31.262363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:31.263546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-65898d48-7bd3-4f85-b908-adcda09c521b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.151790 Aug 10 08:47:31.264133 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 334/660] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:31 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:32.286912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:32.287547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:32.293810 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:32.294298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:32.294765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:32.296118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:32.296575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:32.297002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:32.426865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:32.434797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:32.436297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:32.437443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-65b30f4c-3d47-42d0-96eb-6019ba6bd440 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1723 microversion: 2.20 time: 0.154454 Aug 10 08:47:32.438006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 327/661] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:32 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:33.019907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4806864d-f9df-4b0b-9b3d-6a0e2e960fda", "name": "network-vif-deleted", "tag": "cc963a9c-3082-4363-854d-beced7b78763"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:33.034154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:33.034661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:33.035098 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:33.050904 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] Creating event network-vif-deleted:cc963a9c-3082-4363-854d-beced7b78763 for instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda on hv-cinder-78102 Aug 10 08:47:33.056322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-e626d833-d6a7-403e-8619-2ce70d0c3513 req-d5775bc3-7a2b-453f-925a-58f28d93c880 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098201 Aug 10 08:47:33.056967 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 335/662] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:33.461840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:33.462994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:33.469186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:33.474225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:33.474225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:33.474225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:33.474225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:33.474605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:33.504277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:33.504762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:33.505199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:33.505650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lazy-loading 'fault' on Instance uuid 4806864d-f9df-4b0b-9b3d-6a0e2e960fda {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:47:33.549943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:33.558502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:33.560081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:33.561808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7ec89102-5ada-47dd-a841-8b7fe90cb063 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 200 len: 1372 microversion: 2.20 time: 0.104121 Aug 10 08:47:33.562367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 328/663] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:33 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:34.585825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:34.586536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:34.593142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:34.593619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:34.594049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:34.594760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:34.595210 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:34.595631 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:34.609218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda HTTP/1.1 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:47:34.610868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:47:34.612515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '4806864d-f9df-4b0b-9b3d-6a0e2e960fda'} Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:47:34.613396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:47:34.614994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:34.616324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:47:34.616324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-506c095e-ef97-4fc3-8dc2-8f64186ccc16 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 404 len: 111 microversion: 2.20 time: 0.031159 Aug 10 08:47:34.616324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 336/664] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:34 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:47:34.621083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-df655da4-c9e6-41fe-b8e8-5b6094f0cbe1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '.version_select at 0x7fdef5154940>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:34.692537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-df655da4-c9e6-41fe-b8e8-5b6094f0cbe1 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487756703" status: 204 len: 0 microversion: 2.20 time: 0.075137 Aug 10 08:47:34.693372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 329/665] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 10 08:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487756703 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 08:47:35.532696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4f550633-c05a-42c9-8bd0-ae771dfc790e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: .version_select at 0x7fdef58b9280>, body: {"keypair": {"name": "tempest-keypair-1977906716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjSth1r9/WzQJN0uRwz3hIm5CFdsDJXnQiS1yuviffKfHmLAgVLzCKO0YPptqtN22hP3GVqsS1Ixo1UoyjKD47cXv3cxj2/mTF3+3/Ms2bdhb67ysb/Nk/6v7VhZ4qxNQ=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:35.549163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-4f550633-c05a-42c9-8bd0-ae771dfc790e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for project a1554973bf4b4523b966a9d851b0244a. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:47:35.553427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-4f550633-c05a-42c9-8bd0-ae771dfc790e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for user 0c316e7b121b4d859d9677edcb49be45 and project a1554973bf4b4523b966a9d851b0244a. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:47:35.628072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4f550633-c05a-42c9-8bd0-ae771dfc790e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.101164 Aug 10 08:47:35.628730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 337/666] 10.222.0.45 () {62 vars in 1200 bytes} [Wed Aug 10 08:47:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 08:47:37.867697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-627548100", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "090e2965-bc3f-4473-8c31-dcabdd9a7691"}], "security_groups": [{"name": "tempest-securitygroup--543803912"}], "key_name": "tempest-keypair-1977906716", "user_data": "}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:37.975197 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] validate_networks() for [('090e2965-bc3f-4473-8c31-dcabdd9a7691', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:47:38.380481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:47:38.380900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:47:38.381366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:47:38.381767 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:47:38.382198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:47:38.391128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:38.391596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:38.392020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:38.392850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:38.393301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:38.393717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:38.414020 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for project a1554973bf4b4523b966a9d851b0244a. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:47:38.417888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Getting quotas for user 0c316e7b121b4d859d9677edcb49be45 and project a1554973bf4b4523b966a9d851b0244a. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:47:38.429240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:47:38.431457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:47:38.585256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5e0c4a42-46f1-4b90-9f43-3caa7e303e31 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.722479 Aug 10 08:47:38.586060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 330/667] 10.222.0.45 () {62 vars in 1188 bytes} [Wed Aug 10 08:47:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 08:47:38.598131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:38.600061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:38.654017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:38.662067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:38.663584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:38.664671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e34c9d4b-ae62-4b6c-bb7d-698069079c92 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1281 microversion: 2.20 time: 0.071278 Aug 10 08:47:38.665292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 338/668] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:38 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:39.687803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:39.688499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:39.695650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:39.696127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:39.696559 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:39.697240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:39.697692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:39.698109 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:39.757878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:39.765724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:39.767241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:39.768321 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-935e69c9-855a-4e69-ba2c-bec1aad11909 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1285 microversion: 2.20 time: 0.084979 Aug 10 08:47:39.768940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 331/669] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:39 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:40.791161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:40.791818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:40.798243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:40.798814 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:40.799244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:40.799925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:40.800401 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:40.800821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:40.869891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:40.877929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:40.879516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:40.880612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6815a14e-f30c-43c4-b9cc-6325d55a2be3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1341 microversion: 2.20 time: 0.093579 Aug 10 08:47:40.881167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 339/670] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:40 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1341 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:41.904355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:41.904976 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:41.911508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:41.911994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:41.912431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:41.913119 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:41.913573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:41.913998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:42.049612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:42.057970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:42.059685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:42.060787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-32feae99-a58e-4728-b44f-884e27e6327b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.160780 Aug 10 08:47:42.061337 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 332/671] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:41 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:42.852165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:42.863174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:42.863650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:42.864082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:42.874798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] Creating event network-changed:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:47:42.879676 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-749e5e43-be00-4706-8618-92194a28c05a req-2b249566-164e-4bcd-9727-10f83b3ec64e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032545 Aug 10 08:47:42.880269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 340/672] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:42.917178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:42.917686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:42.925088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:42.925573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:42.926949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:42.927652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:42.928104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:42.928581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:42.952008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c8340543-39c3-4aea-bdd2-8db359cdcdd5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/ips" status: 200 len: 151 microversion: 2.1 time: 0.038589 Aug 10 08:47:42.952591 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 333/673] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:47:42 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:42.965323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da42e170-64c2-43b3-94c5-352c6a02e088"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:42.967852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:42.974632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:42.975115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:42.975550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:42.976246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:42.976697 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:42.977121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.054944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: POST /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/os-volume_attachments HTTP/1.1 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 74 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:47:43.056766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {"volumeAttachment": {"volumeId": "da42e170-64c2-43b3-94c5-352c6a02e088"}} Aug 10 08:47:43.058270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'server_id': 'f29c280c-b091-4dc5-afb8-89e58f6371de', 'body': {'volumeAttachment': {'volumeId': 'da42e170-64c2-43b3-94c5-352c6a02e088'}}} Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:43.059193 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:43.060591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 400 to user: Invalid volume: volume da42e170-64c2-43b3-94c5-352c6a02e088 is already attached to instances: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9d08fc3d-fcad-485d-bc96-a7b4515ef60a tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097441 Aug 10 08:47:43.061937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 341/674] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:47:42 2022] POST /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:47:43.066706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:43.067198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:43.073601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.073601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.074636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.074747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.075176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.075595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.085845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:43.086499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:43.094940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.095456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.095891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.096590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.097046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.097470 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.101719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:47:43.271593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:43.280281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:43.282487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:43.283685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b66c2d9d-7901-4e6c-b739-b6442d9664a4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.201862 Aug 10 08:47:43.286671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 342/675] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:43 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:43.382873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9b1463d1-5c44-4c86-9750-9246971bce2b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 204 len: 0 microversion: 2.1 time: 0.319513 Aug 10 08:47:43.383855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 334/676] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:47:43 2022] DELETE /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:47:43.392262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:43.392872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:43.398786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.399262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.399691 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.400371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:43.400825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:43.401240 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:43.527305 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:43.534844 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d609cd80-b38e-44da-9cff-f4bbce9773b9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1682 microversion: 2.1 time: 0.146918 Aug 10 08:47:43.535400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 343/677] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:43 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:44.307103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:44.307717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:44.313972 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:44.314444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:44.314898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:44.315570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:44.316016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:44.316432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:44.441527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:44.449376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:44.450888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:44.451977 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b77c0cb5-be56-4019-8c35-a2d108bacd14 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.149439 Aug 10 08:47:44.452538 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 335/678] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:44 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:44.555952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:44.556563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:44.563040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:44.563463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:44.563895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:44.564580 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:44.565036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:44.565461 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:44.704721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:44.712215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-518a47d9-1ab6-4184-a950-72a1e3c2f2f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1682 microversion: 2.1 time: 0.160110 Aug 10 08:47:44.712782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 344/679] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:44 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:45.475184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:45.475959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:45.483177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:45.483681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:45.484116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:45.485317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:45.485867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:45.486296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:45.621899 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:45.630363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:45.631931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:45.633075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6eb9db9c-c72c-451a-a821-4697c6b34d8e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.162048 Aug 10 08:47:45.633635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 336/680] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:45 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:45.734627 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:45.735523 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:45.742440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:45.742973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:45.743399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:45.744083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:45.744533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:45.744952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:46.204106 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:46.211477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a6829828-5c94-4276-8d0d-8efeb94a0dcf tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1682 microversion: 2.1 time: 0.480957 Aug 10 08:47:46.212060 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 345/681] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:45 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1682 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:46.655943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:46.657039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:46.663774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:46.664260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:46.664691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:46.665381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:46.665829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:46.666249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:46.690727 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29c280c-b091-4dc5-afb8-89e58f6371de", "name": "network-vif-deleted", "tag": "d740bb5d-ec07-49f1-974e-d3be4e5d30f6"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:46.700789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:46.701351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:46.701866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:46.713989 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] Creating event network-vif-deleted:d740bb5d-ec07-49f1-974e-d3be4e5d30f6 for instance f29c280c-b091-4dc5-afb8-89e58f6371de on hv-cinder-78102 Aug 10 08:47:46.720198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-94b6d043-7e7d-4bdb-89c9-ffd2928e6c79 req-4263aba9-622d-4ff2-a519-a9ab93e53bd7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Aug 10 08:47:46.721351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 346/682] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:46.802419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:46.810798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:46.812301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:46.813468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-da01d27e-7b9b-46d2-bd49-3c626c3c8fe0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.161360 Aug 10 08:47:46.820503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 337/683] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:46 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:47.233559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:47.234422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:47.240562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:47.241042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:47.241475 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:47.242162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:47.242662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:47.243087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:47.305468 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:47.313579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-57019105-6811-4a9b-895d-f401a212169e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1615 microversion: 2.1 time: 0.084648 Aug 10 08:47:47.314237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 347/684] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:47 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:47.835589 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:47.836196 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:47.842649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:47.843130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:47.843569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:47.844252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:47.844709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:47.845133 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:47.971308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:47.979158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:47.980654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:47.981753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c01704eb-022e-4542-a297-ea0e5fc058f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.150006 Aug 10 08:47:47.982371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 338/685] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:47 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:48.334389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:48.335070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:48.341435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:48.341915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:48.342349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:48.343064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:48.343517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:48.343938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:48.404038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:48.411350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f3a77fe2-5b03-4fa3-9b2e-0a05cb858010 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1615 microversion: 2.1 time: 0.080779 Aug 10 08:47:48.411911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 348/686] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:48 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1615 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:49.003901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:49.004503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:49.006425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.007275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=6 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.012498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.020614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.020614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.020614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.020614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.020959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.033996 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.146730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:49.155179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:49.157204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:49.158503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a477aa30-0082-4797-94bb-9a29262f0169 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.158298 Aug 10 08:47:49.159060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 339/687] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:48 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:49.433106 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:49.433711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:49.435735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.441592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.442291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.442501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.443181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.443632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.444048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.474618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.475099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.475524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.475965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lazy-loading 'fault' on Instance uuid f29c280c-b091-4dc5-afb8-89e58f6371de {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:47:49.478668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:49.517394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:49.523991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-98bbdeb5-59e9-4b5f-9142-a80005c1198f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 200 len: 1331 microversion: 2.1 time: 0.094969 Aug 10 08:47:49.524581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 349/688] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:49 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:49.884474 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:49.884968 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:49.891312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.891798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.892246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:49.892935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:49.893395 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:49.896188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.019221 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'services' on Instance uuid afbe8c40-e90c-4e86-aa84-a0570bd3253b {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:47:50.182018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:50.182662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:50.190510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.190990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.191421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.192097 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.192584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.193004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.252204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-795e05dc-c6ea-4204-bef0-21367cdc0e88 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments/bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f" status: 202 len: 0 microversion: 2.1 time: 0.371492 Aug 10 08:47:50.253107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 340/689] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:47:49 2022] DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments/bb5a4fa0-aaf0-4a1e-9e0d-4f48c8860f0f => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:47:50.267324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:50.271488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:50.283185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.284063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.284825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.286086 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.287045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.287826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.322273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-36a715ed-1bc3-4989-81f7-e1d99d20d95f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063070 Aug 10 08:47:50.322868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 341/690] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:50 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:50.342020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:50.350407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:50.352020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:50.353127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-27111f06-5c39-45ee-88ab-22ffa338340f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.175326 Aug 10 08:47:50.354576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 350/691] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:50 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:50.545916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:50.546458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:50.552332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.552815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.553254 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.553942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:50.554405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:50.554855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:50.567986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de HTTP/1.1 Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:47:50.569593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:47:50.571149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'f29c280c-b091-4dc5-afb8-89e58f6371de'} Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:47:50.572007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:47:50.573406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:47:50.574678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:47:50.574678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fa5acdc0-8d2d-4696-b68d-0bda1f2a96d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 404 len: 111 microversion: 2.1 time: 0.029144 Aug 10 08:47:50.574678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 342/692] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:50 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:47:50.580454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-95f73d1c-4261-4a46-a775-1e69465e4f27 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '.version_select at 0x7fdef591c430>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:50.646075 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-95f73d1c-4261-4a46-a775-1e69465e4f27 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616913050" status: 202 len: 0 microversion: 2.1 time: 0.069898 Aug 10 08:47:50.646719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 351/693] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 08:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616913050 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:47:51.335179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:51.341469 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:51.343600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.344079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.344608 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.345377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.345828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.346246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.412789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:51.412789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:51.413066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-005c0ff4-c5dd-45c4-b755-54418d6c9b30 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Aug 10 08:47:51.413066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 343/694] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:51 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:51.413248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.413248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.413248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.413248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.413584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.413584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.432539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:51.433226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:51.441440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.441660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.442104 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.442900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.443354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.443779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.535542 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:51.544407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:51.546127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:51.551237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bb2b0e19-49fe-4c33-b361-8a642446eeb8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.175562 Aug 10 08:47:51.554907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 352/695] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:51 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:51.572468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lazy-loading 'services' on Instance uuid 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:47:51.758259 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b72d7e7b-544a-4215-855d-558446766d50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments/da42e170-64c2-43b3-94c5-352c6a02e088" status: 202 len: 0 microversion: 2.1 time: 0.329461 Aug 10 08:47:51.758969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 344/696] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:47:51 2022] DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments/da42e170-64c2-43b3-94c5-352c6a02e088 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:47:51.767273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:51.769445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:51.775740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.776485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.776915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.777608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:51.778056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:51.778530 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:51.809858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e5a6d7e1-6a85-4286-9786-1db754215def tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Aug 10 08:47:51.810414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 353/697] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:51 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:52.423562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:52.425867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:52.432089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.432580 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.433000 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.434317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.435092 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.435526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.467366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-84204d0b-db6e-49f6-82db-6856563c5f3a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048643 Aug 10 08:47:52.471523 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 345/698] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:52 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:47:52.553801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:52.554253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:52.560564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.561044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.561503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.562183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.563285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.563740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.569177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:52.569772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:52.575596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.576069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.576596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.577278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.577732 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.578787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.591055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:47:52.712522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:52.718497 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:52.720007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:52.721099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6c98cfec-5ff2-4d83-be37-fcc87d40234a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.155741 Aug 10 08:47:52.721673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 346/699] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:52 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:52.821224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:52.823399 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:52.829342 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.829818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.830255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.830978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.831436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.831854 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.861062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a4fe724b-03cf-4bdf-b740-e5b67a7c6252 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Aug 10 08:47:52.868352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 347/700] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:52 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:47:52.880495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-48eb1e56-5584-4aa4-b9c9-b8f3f6501be4 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 204 len: 0 microversion: 2.1 time: 0.330013 Aug 10 08:47:52.883009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 354/701] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:47:52 2022] DELETE /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:47:52.892021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:52.892630 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:52.899239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.899738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.900326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:52.901030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:52.901745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:52.902172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.031313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "name": "network-vif-plugged", "status": "completed", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:53.039463 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:53.040867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:53.041366 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:53.041798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.048213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-21ba0995-0a9b-4df4-9156-59de2b99899c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1691 microversion: 2.1 time: 0.160442 Aug 10 08:47:53.048974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 348/702] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:52 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:47:53.060709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] Creating event network-vif-plugged:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:47:53.064809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-23f2a997-8225-4592-b336-6b46e3e0d39c req-d3a03209-98e3-4376-baf2-a1b0054069df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098924 Aug 10 08:47:53.065420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 355/703] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:47:53.743773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:53.744358 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:53.750737 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:53.751291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:53.751720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.752407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:53.752867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:53.753318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.874556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:53.877629 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:53.879964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:53.884215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:53.884771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:53.885277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.886042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:53.886604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:53.887141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:53.887886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:53.889440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:53.891268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a4d981fe-63a4-4f6e-9f34-2da063dc97a9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.150835 Aug 10 08:47:53.891832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 349/704] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:53 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:53.917639 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4cfee903-1a09-4fd4-8991-bd95882affca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Aug 10 08:47:53.918388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 356/705] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:53 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:47:54.069487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:54.070037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:54.076080 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.076559 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.077061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.077742 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.078890 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.079309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.206180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:54.213678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-99d6b394-7158-4f96-9d50-a2a1c85c6628 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1691 microversion: 2.1 time: 0.148154 Aug 10 08:47:54.214239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 350/706] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:54 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:54.913903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:54.914524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:54.920874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.921359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.921801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.922513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.922969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.923395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.932438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:54.934549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:54.941094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.941784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.942016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.942745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:54.943195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:54.943615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:54.975034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2cab2206-30b9-4523-98db-7baa88c4f297 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Aug 10 08:47:54.975613 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 351/707] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:54 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:55.058705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:55.066568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:55.068064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:55.069171 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-46e22d93-3626-4c39-9944-d0deb50b2ed4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.159227 Aug 10 08:47:55.069746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 357/708] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:54 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:55.234344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:55.234974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:55.240791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:55.241269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:55.241699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:55.242376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:55.242851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:55.243274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:55.370552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:55.378823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0bf8fa02-ba8a-42b7-8c86-28342c41d093 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1691 microversion: 2.1 time: 0.148097 Aug 10 08:47:55.379396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 352/709] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:55 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:55.987115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:55.989310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:55.995687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:55.996163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:55.996592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:55.997264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:55.997713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:55.998130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:56.026667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d6a79042-3629-4a23-9edf-7f6ac657102c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Aug 10 08:47:56.027213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 358/710] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:55 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:56.092103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:56.092711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:56.099719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:56.103667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:56.103667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:56.103667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:56.103667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:56.104039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:56.233733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:56.243201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:56.244872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:56.245999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fa0f9751-5461-4a5c-a803-1f47a4789ade tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.157890 Aug 10 08:47:56.246611 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 353/711] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:56 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:56.400628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:56.401630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:56.407507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:56.411956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:56.411956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:56.411956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:56.411956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:56.412408 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:56.561555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:56.569325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1c9f463c-d371-46c5-a32e-5cbcc8226c8e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1691 microversion: 2.1 time: 0.172583 Aug 10 08:47:56.569905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 359/712] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:56 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:57.039443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:57.041521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:57.043565 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:57.048729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.049199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.049626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.050306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.050784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.051199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.078717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-734e79aa-01ba-44c5-93db-3e9bf94ed739 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043176 Aug 10 08:47:57.079272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 354/713] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:47:57 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:47:57.144435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:57.144957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:57.147384 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:57.152765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.153466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.154139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.155023 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.155589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.156089 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.181868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:47:57.267386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:57.268124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:57.274837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.275318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.275747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.276713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.280148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.281293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.300227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:57.421806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:57.427071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d842c6b6-bed3-4aa5-9318-b4e33fe8cea7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 204 len: 0 microversion: 2.1 time: 0.286754 Aug 10 08:47:57.427678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 360/714] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:47:57 2022] DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:47:57.436034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:57.436034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:57.436034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-40fe6542-cbe2-4f77-8e1b-997da49b9f45 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.170485 Aug 10 08:47:57.436435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 355/715] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:57 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:47:57.451056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:57.451757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:57.457885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.458350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.458820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.459511 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.459958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.460377 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.597186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:57.597345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:57.603914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.604406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.604850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.605551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.606006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.606432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.672933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:57.681291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-357541c9-b7f5-4662-ac4f-fce086aa2ddb tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1624 microversion: 2.1 time: 0.090780 Aug 10 08:47:57.681878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 356/716] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:57 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1624 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:57.684859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:57.686728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbe8c40-e90c-4e86-aa84-a0570bd3253b", "name": "network-vif-deleted", "tag": "a4e714f2-f251-4b24-9e19-4a235ba1bc05"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:47:57.693651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b5291c87-b33f-484b-a093-e604ee5ea29f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1681 microversion: 2.1 time: 0.261348 Aug 10 08:47:57.694935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 361/717] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:57 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:57.701565 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:57.702279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:57.702909 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:57.714952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] Creating event network-vif-deleted:a4e714f2-f251-4b24-9e19-4a235ba1bc05 for instance afbe8c40-e90c-4e86-aa84-a0570bd3253b on hv-cinder-78102 Aug 10 08:47:57.720539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-6421fcb7-e078-499b-a808-21fad646a23f req-c8042146-f2c2-4300-97d6-f4e690b9425a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Aug 10 08:47:57.721141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 357/718] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:47:58.457148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:58.457771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:58.465286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.465782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.466390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.467123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.467852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.468022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.604434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:58.613354 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:58.615027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:58.616163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-be4e3f1c-8a5d-4081-8303-319ae8f29396 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.163706 Aug 10 08:47:58.616726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 362/719] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:58 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:58.714241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:58.715108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:58.716953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:58.718065 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:58.723160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.723645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.723778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.724075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.724409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.724765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.724894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.725247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.725679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.725787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:58.726295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:58.726807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:58.793676 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:58.801865 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8111af92-2bb3-461e-9c41-b37f88b12402 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1331 microversion: 2.1 time: 0.092260 Aug 10 08:47:58.802363 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 358/720] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:58 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:47:58.856414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:58.864513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2a751635-7a60-4565-b009-aaeb647026c8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1681 microversion: 2.1 time: 0.151469 Aug 10 08:47:58.865077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 363/721] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:58 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:47:59.639156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:59.639752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:59.646218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.646726 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.647161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.647829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.648280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.648695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.780010 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:59.788743 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:59.790223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:59.791352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6606efbe-ef95-4bd6-b22a-01d4bff134bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1406 microversion: 2.20 time: 0.156049 Aug 10 08:47:59.791942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 359/722] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:47:59 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:47:59.822969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:59.823576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:59.830749 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.831230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.831659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.832334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.832781 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.833199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.850715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:47:59.885321 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:47:59.885929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:47:59.892648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.893135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.893601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.893925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:47:59.894298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:47:59.894774 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:47:59.895201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:47:59.901520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-11ee0a5b-78b5-49c5-b423-31c5377992ca tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1331 microversion: 2.1 time: 0.082190 Aug 10 08:47:59.902096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 364/723] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:59 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1331 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:00.021117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:00.028757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-eb791c1d-b9b0-4042-8e2f-b3675b98c1ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1681 microversion: 2.1 time: 0.147281 Aug 10 08:48:00.029324 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 360/724] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:47:59 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:00.671257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:00.674365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:00.680853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.681339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.681778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:00.682484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.682956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.683402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:00.711946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-567be4bd-50fe-4fed-a12a-42b254969e70 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045282 Aug 10 08:48:00.712688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 365/725] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:48:00 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:48:00.777857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:00.778357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:00.786096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.786674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.787038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:00.787870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.788249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.788676 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:00.813514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:00.814438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:00.820290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:48:00.820788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.821279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.821711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:00.822565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:00.822862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:00.823774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.054566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.063028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.064529 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.065695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3753c7f6-2c62-486d-a24e-b0aba91b2cc5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1597 microversion: 2.20 time: 0.256477 Aug 10 08:48:01.066447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 366/726] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:48:00 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1597 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:48:01.070992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:01.071598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:01.077335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.077824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.078258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.078976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.079920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.080346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.111268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.111749 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.112179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.112675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'fault' on Instance uuid afbe8c40-e90c-4e86-aa84-a0570bd3253b {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:01.175604 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-12430816-c3ee-4643-aae2-b9a1b1736ca8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 204 len: 0 microversion: 2.1 time: 0.401378 Aug 10 08:48:01.176451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 361/727] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:48:00 2022] DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:48:01.177963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.182366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:01.198679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:01.198840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c88fd293-efb6-4001-a5e8-2702b7f2758f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 200 len: 1336 microversion: 2.1 time: 0.118068 Aug 10 08:48:01.198840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 367/728] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:01 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:01.199028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.199028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.199028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.199028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.199355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:01.199454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.199547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:01.199649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.199748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.199748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.199748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.200282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.200733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.201151 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.318178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f35d8add-8916-4249-a3e0-d8c8ddf43cd7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130694 Aug 10 08:48:01.318894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 368/729] 10.222.0.45 () {60 vars in 1316 bytes} [Wed Aug 10 08:48:01 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:48:01.327236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:01.327236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:01.334306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.335148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.336374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.337716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:01.338379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:01.339019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:01.343728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.351698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5e72a784-4ab1-4c0d-8cbc-25c8ccd3200c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1681 microversion: 2.1 time: 0.173784 Aug 10 08:48:01.365892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 362/730] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:01 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:01.661134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:01.668888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c79edbc0-ebf6-471b-93d2-a9b637609fc7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1674 microversion: 2.1 time: 0.348839 Aug 10 08:48:01.669462 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 369/731] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:01 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1674 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:02.209378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:02.210120 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: afbe8c40-e90c-4e86-aa84-a0570bd3253b] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:02.216824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.217605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.218211 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.219122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.219583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.220038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.233388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] HTTP exception thrown: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Request method failure captured: Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b HTTP/1.1 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829I0s8OLLd7kgYfQFsl1J1623noD67FD3sKctS7l0sDbxkw2bLNMkm4Gl7WZJOLtHfWtrg77e-tt47ew0CT7Gj2wgE5jDAaqLZzWzK8_vEjzgsw_k2syerqtpJMzWGToUkn_ddLyOOz7AgqW3rAA5u_P7tMgqIgyNeptsV1BWQzvs4 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:48:02.235056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5c6694dd460a467a986bcaa0e5e000a9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: d28b7a7b2e0143cf9ee6e761eb7fb281 Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. Aug 10 08:48:02.236707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'afbe8c40-e90c-4e86-aa84-a0570bd3253b'} Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:02.237853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. Aug 10 08:48:02.239158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:02.241053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Returning 404 to user: Instance afbe8c40-e90c-4e86-aa84-a0570bd3253b could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:02.241053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6b55e136-2afd-4b32-92c9-7d18dc250e8f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b" status: 404 len: 111 microversion: 2.1 time: 0.031833 Aug 10 08:48:02.241053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 363/732] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:02 2022] GET /compute/v2.1/servers/afbe8c40-e90c-4e86-aa84-a0570bd3253b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:02.246862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6fad169f-1ea6-429b-9ef9-da4ea2e49bb3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '.version_select at 0x7fdef5940e50>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:02.303618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6fad169f-1ea6-429b-9ef9-da4ea2e49bb3 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473296745" status: 202 len: 0 microversion: 2.1 time: 0.060932 Aug 10 08:48:02.304135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 370/733] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 08:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473296745 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:48:02.374169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:02.375484 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:02.384539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.385503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.385989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.386752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.387213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.387642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.414008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db10e43-3a1e-4f21-a834-f8f9e85dbf94", "name": "network-vif-deleted", "tag": "ea8c7ee1-cefb-4b08-af72-d8f44ac5497b"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:02.430357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.430949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.431391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.451776 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] Creating event network-vif-deleted:ea8c7ee1-cefb-4b08-af72-d8f44ac5497b for instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 on hv-cinder-78102 Aug 10 08:48:02.457416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-15179fb7-5c75-45b7-ab26-7cbe28c5eb31 req-d08a2acc-fae8-410e-8b45-0d8313de87ee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047194 Aug 10 08:48:02.458333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 371/734] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:02.490042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:02.498407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-07cc514c-df53-48ee-b76f-6e6f46613cb8 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1614 microversion: 2.1 time: 0.128760 Aug 10 08:48:02.499259 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 364/735] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:02 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:02.697281 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:02.698966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:02.715965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.716762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.717515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:02.719084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:02.719822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:02.720403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:03.031425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:03.043859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5bc1e56f-12a1-4a71-a557-53687816db56 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1674 microversion: 2.1 time: 0.355202 Aug 10 08:48:03.076392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 372/736] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:02 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1674 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:03.525157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:03.525838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:03.536180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:03.536679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:03.537124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:03.537832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:03.538434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:03.543102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:03.598629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:03.599125 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:03.599625 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:03.600167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lazy-loading 'fault' on Instance uuid 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:03.645214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:03.653669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4c1b3e75-9070-4a5a-afe2-24d7b6d8363b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 200 len: 1332 microversion: 2.1 time: 0.135890 Aug 10 08:48:03.654267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 365/737] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:03 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 1332 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:04.065682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:04.067078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:04.073253 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:04.073956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:04.074399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:04.075478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:04.075936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:04.076616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:04.161411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:04.174355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-48a3f184-5f30-4112-8a00-ec25b6ab36d0 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1606 microversion: 2.1 time: 0.112700 Aug 10 08:48:04.176120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 373/738] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:04 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1606 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:04.484099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}, {"server_uuid": "ecd54a38-d75c-4105-80d5-02e459816b82", "name": "network-vif-deleted", "tag": "6a2c4332-79ff-43b9-a9bc-89a58d83b87e"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:04.504051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:04.504986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:04.505713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:04.519953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Creating event network-changed:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:48:04.520460 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] Creating event network-vif-deleted:6a2c4332-79ff-43b9-a9bc-89a58d83b87e for instance ecd54a38-d75c-4105-80d5-02e459816b82 on hv-cinder-78102 Aug 10 08:48:04.527231 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-15c0cc13-c81e-4a55-97f5-48f9faf9b5ce req-f590a218-a357-477c-baf3-f012f43ad4b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046962 Aug 10 08:48:04.531216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 366/739] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:04.739623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:04.740271 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:04.746148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:04.746675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:04.747234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:04.747942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:04.748402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:04.748832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:04.762871 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 HTTP/1.1 Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:48:04.764514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:48:04.766070 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '0db10e43-3a1e-4f21-a834-f8f9e85dbf94'} Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:04.767072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:48:04.768471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:04.769709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:04.769709 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b0ad81fc-f082-4d67-8613-47a92c571e60 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 404 len: 111 microversion: 2.1 time: 0.094490 Aug 10 08:48:04.769976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 374/740] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:04 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:04.776293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d9d066b3-01e4-4b94-80f3-d73f8a7a883f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '.version_select at 0x7fdef520b4c0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:04.834691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d9d066b3-01e4-4b94-80f3-d73f8a7a883f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712103761" status: 202 len: 0 microversion: 2.1 time: 0.063159 Aug 10 08:48:04.835769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 367/741] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 08:48:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1712103761 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:48:05.214990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:05.216131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:05.223725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:05.224287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:05.225053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:05.225830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:05.226356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:05.227036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:05.292390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:05.293112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:05.293947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:05.294598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lazy-loading 'fault' on Instance uuid ecd54a38-d75c-4105-80d5-02e459816b82 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:05.370503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:05.378927 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-74fd15ba-5358-4435-8a51-07ec913f499a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 200 len: 1327 microversion: 2.1 time: 0.167743 Aug 10 08:48:05.379516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 375/742] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:05 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:05.702810 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-365796092"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:05.703466 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:05.710868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:05.711410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:05.711861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:05.712538 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:05.713044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:05.713474 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:05.728872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3c6c4409-f520-425b-8181-0dd9f317fa25 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: .version_select at 0x7fdef77db160>, body: {"keypair": {"name": "tempest-keypair-669523742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI66i4JkqtflR5leI34ZKS1psCcwOxme0d1EdmE4avuGMMp4BHyVlBtm6GYVF9/Z5cRxxudkECpiVeutElaMXjlS9aMKcgIgGIkZ4sMSOUPs5XBIW8GDMfcX3Py8/jYnQ=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:05.743810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-3c6c4409-f520-425b-8181-0dd9f317fa25 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:48:05.747723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-3c6c4409-f520-425b-8181-0dd9f317fa25 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:48:05.818108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3c6c4409-f520-425b-8181-0dd9f317fa25 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093053 Aug 10 08:48:05.818885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 376/743] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:48:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:05.847849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.network.security_group_api [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Removing security group 29b27965-c44f-4d6f-bd95-980a79040fde from port 4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 Aug 10 08:48:06.237189 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1695fda1-6e2f-4619-a1a7-4a832bca602c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action" status: 202 len: 0 microversion: 2.1 time: 0.538345 Aug 10 08:48:06.237802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 368/744] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:48:05 2022] POST /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:48:06.328811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:06.329609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:06.340475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.340475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.340475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.340475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.340836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.341174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.363407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:06.373045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:48:06.375510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.376809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.377325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.390948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] Creating event network-changed:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:48:06.398978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-f4a1dfb1-fb7f-41b5-b78f-43f83b63e9db req-4cd406c9-d976-4b18-ab6a-2d162d872e5d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151670 Aug 10 08:48:06.402280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 377/745] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:06.410117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:06.410981 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:06.418027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.418693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.419349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.420194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.420758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.421351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.437392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 HTTP/1.1 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:48:06.439932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:48:06.441797 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'ecd54a38-d75c-4105-80d5-02e459816b82'} Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:06.442708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:48:06.444110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:06.445997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:06.447041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-32b7bc44-2be0-4ee9-bd25-188007801ad4 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 404 len: 111 microversion: 2.1 time: 0.042337 Aug 10 08:48:06.447816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 378/746] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:06 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:06.456303 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f7ae1819-e168-4119-9926-4dfbf7f61a28 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '.version_select at 0x7fdef57e7ee0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:06.597351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f7ae1819-e168-4119-9926-4dfbf7f61a28 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205471185" status: 202 len: 0 microversion: 2.1 time: 0.144927 Aug 10 08:48:06.601410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 379/747] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 08:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205471185 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:48:06.740117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4c7d2853-e779-4fc9-b214-750d7fc4a10f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 204 len: 0 microversion: 2.1 time: 0.412928 Aug 10 08:48:06.741995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 369/748] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:48:06 2022] DELETE /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:48:06.750337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:06.751616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:06.764806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.768405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.768405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:06.768405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:06.768405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:06.768796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:07.086803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:07.095700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7b3f6050-5800-4bc8-af49-b7d106de6db9 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1508 microversion: 2.1 time: 0.349200 Aug 10 08:48:07.096617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 380/749] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:06 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:07.620228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e4f3af67-97e4-4ff6-b836-0add7c7a10e7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: .version_select at 0x7fdef520baf0>, body: {"keypair": {"name": "tempest-keypair-377151079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOapKfFPqAubRBYDqnEFhquByF3n7kCGqXXr2A09aMjXKSPU3I83YuX3lWN2fMKHxudTFBRphd/68puwCaEvGDlvXK5BDvkqwNofumt1zVp+DtiVRMf1MzYMTkCIbon1vg=="}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:07.636056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-e4f3af67-97e4-4ff6-b836-0add7c7a10e7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:48:07.639916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-e4f3af67-97e4-4ff6-b836-0add7c7a10e7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for user 661a67fbdd6941889c706d2560c920a2 and project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:48:07.767530 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e4f3af67-97e4-4ff6-b836-0add7c7a10e7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150830 Aug 10 08:48:07.769364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 370/750] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:48:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:07.946277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:07.947203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:07.955141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:07.955888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:07.956384 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:07.957329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:07.957845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:07.958322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.059454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lazy-loading 'services' on Instance uuid 26db3bb7-f656-460d-9c4b-24879a9f3480 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:08.117515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:08.118249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:08.124208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:08.124895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:08.125508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.126757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:08.127252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:08.127636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.282624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:08.282624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d7a2645e-98b7-44a9-899b-fb3867999017 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1508 microversion: 2.1 time: 0.164347 Aug 10 08:48:08.282624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 371/751] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:08 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:08.342529 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fc932abe-4d65-4c8c-ad99-5d710514177a tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments/78a7ca72-a7b2-4fd9-ab75-91eff424966c" status: 202 len: 0 microversion: 2.1 time: 0.399676 Aug 10 08:48:08.350027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 381/752] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:48:07 2022] DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments/78a7ca72-a7b2-4fd9-ab75-91eff424966c => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:48:08.356273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:08.364072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:08.371792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:08.372437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:08.372928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.374241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:08.374955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:08.376955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.416582 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:08.417147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:08.426935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-55b612cc-02e3-44fe-9ff0-7dd9ea28e1bf tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078813 Aug 10 08:48:08.430618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 372/753] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:48:08 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:08.431146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:08.431628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:08.432056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:08.446554 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] Creating event network-changed:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:48:08.454993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-b9b056d2-a04c-4c38-9dcd-670b35e3089f req-d2342e3a-f4ff-4677-879b-a87475c6c0a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042922 Aug 10 08:48:08.455821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 382/754] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:09.209405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191981889", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec743362-15f5-4239-ba7d-fe3ce8ba53bc"}], "security_groups": [{"name": "tempest-securitygroup--1222286842"}], "key_name": "tempest-keypair-669523742", "user_data": "}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:09.288610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e85da63-17bd-4d1c-92c4-e12595e0b6da", "name": "network-vif-deleted", "tag": "7431278b-00fa-422a-a466-7dead1e1d119"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:09.301422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.302234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.302857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.317038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] Creating event network-vif-deleted:7431278b-00fa-422a-a466-7dead1e1d119 for instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da on hv-cinder-78102 Aug 10 08:48:09.322369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-8acd2dd1-a1d9-4bfe-9131-0b4684350c15 req-d2231519-37c3-4481-ae3b-3803cc724748 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041124 Aug 10 08:48:09.323896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 383/755] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:09.332974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:09.334001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:09.341589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.343090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.343090 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.343869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.344739 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.345879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.354246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] validate_networks() for [('ec743362-15f5-4239-ba7d-fe3ce8ba53bc', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:48:09.530893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:09.540931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f927dc0f-aa5e-4769-95e9-c3a9d87128b2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 200 len: 1466 microversion: 2.1 time: 0.214546 Aug 10 08:48:09.542807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 384/756] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:09 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 1466 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:09.552297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:09.558287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:09.569501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.570175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.571589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.572455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.572872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.574229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.610546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4cefa112-6781-4b9d-bad9-aca6c0ea4c02 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065719 Aug 10 08:48:09.612714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 385/757] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:48:09 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:09.829692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:48:09.830270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:48:09.830838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:48:09.831336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:48:09.831813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:48:09.840801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.841375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.841874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.842924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:09.843458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:09.843961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:09.861271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:48:09.865681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:48:09.877878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:48:09.880185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:48:10.045831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9505986f-0a6f-483e-8061-b30e1be91b0e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.840801 Aug 10 08:48:10.046494 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 373/758] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:48:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:48:10.057680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1763bc56-a825-4554-977e-314eed5d26f5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.058507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1763bc56-a825-4554-977e-314eed5d26f5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.408662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1763bc56-a825-4554-977e-314eed5d26f5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:10.430177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1763bc56-a825-4554-977e-314eed5d26f5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1240 microversion: 2.1 time: 0.372109 Aug 10 08:48:10.430177 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 386/759] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:10 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1240 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:10.562413 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.565783 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: 1e85da63-17bd-4d1c-92c4-e12595e0b6da] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.570206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.570926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.571359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.572270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.572694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.573285 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.587745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] HTTP exception thrown: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Request method failure captured: Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da HTTP/1.1 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829I0s8OLLd7kgYfQFsl1J1623noD67FD3sKctS7l0sDbxkw2bLNMkm4Gl7WZJOLtHfWtrg77e-tt47ew0CT7Gj2wgE5jDAaqLZzWzK8_vEjzgsw_k2syerqtpJMzWGToUkn_ddLyOOz7AgqW3rAA5u_P7tMgqIgyNeptsV1BWQzvs4 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:48:10.589503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5c6694dd460a467a986bcaa0e5e000a9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: d28b7a7b2e0143cf9ee6e761eb7fb281 Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. Aug 10 08:48:10.591223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '1e85da63-17bd-4d1c-92c4-e12595e0b6da'} Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:10.592088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. Aug 10 08:48:10.593668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.595878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Returning 404 to user: Instance 1e85da63-17bd-4d1c-92c4-e12595e0b6da could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:10.595878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a9e42c04-6b56-4424-9218-1a5b26b9e2f2 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da" status: 404 len: 111 microversion: 2.1 time: 0.032490 Aug 10 08:48:10.595878 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 374/760] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:10 2022] GET /compute/v2.1/servers/1e85da63-17bd-4d1c-92c4-e12595e0b6da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:10.599960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.600455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.607115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.607695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.608471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.609334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.609787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.611033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.623512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.625738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.633448 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.636579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.636579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.636579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.636579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.636964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.639086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:48:10.655651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:10.667132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4c4aa2f1-6255-4128-820c-5d79190f04e4 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047621 Aug 10 08:48:10.671152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 375/761] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:48:10 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:48:10.678188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.678713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.684606 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.685092 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.685521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.686259 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.686751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.687191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.761937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] HTTP exception thrown: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 is not attached to volume 78a7ca72-a7b2-4fd9-ab75-91eff424966c Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Request method failure captured: Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments/78a7ca72-a7b2-4fd9-ab75-91eff424966c HTTP/1.1 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82_Mpli9DqrGCqXy792wpKTlxfzuU33CuIxPYxyMMkVqgVbcbMfeCX9m8OJR0scKvReiigC-g5ioWbmrP_794HFx2Y1hAI-hjvAropMn6t_zakO__m7D8Zf3SGjG--v2AfrtsQTK4mb_jwXeVyvDgnwGWANyzuibAWgcDnW1EkrK1pc Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 970da6acbc464dee8191789eec7ba844 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:48:10.774368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/970da6acbc464dee8191789eec7ba844"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/970da6acbc464dee8191789eec7ba844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/970da6acbc464dee8191789eec7ba844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_970da6acbc464dee8191789eec7ba844", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 970da6acbc464dee8191789eec7ba844 Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-TestMinimumBasicScenario-140243077-project Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 12404366fbba4d1dbb554dcfe65c34d9 Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-TestMinimumBasicScenario-140243077-project Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:48:10.776233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 is not attached to volume 78a7ca72-a7b2-4fd9-ab75-91eff424966c Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'server_id': '26db3bb7-f656-460d-9c4b-24879a9f3480', 'id': '78a7ca72-a7b2-4fd9-ab75-91eff424966c'} Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 78a7ca72-a7b2-4fd9-ab75-91eff424966c. Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:10.777079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 is not attached to volume 78a7ca72-a7b2-4fd9-ab75-91eff424966c Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 is not attached to volume 78a7ca72-a7b2-4fd9-ab75-91eff424966c Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:10.778723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Returning 404 to user: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 is not attached to volume 78a7ca72-a7b2-4fd9-ab75-91eff424966c {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:10.780022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6c61b71c-56be-499b-9a9f-446e10b1486c tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments/78a7ca72-a7b2-4fd9-ab75-91eff424966c" status: 404 len: 154 microversion: 2.1 time: 0.102375 Aug 10 08:48:10.780022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 376/762] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:48:10 2022] DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480/os-volume_attachments/78a7ca72-a7b2-4fd9-ab75-91eff424966c => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 08:48:10.925046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-73b78c4a-4bdf-4594-a09a-066f41ff1d1d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 204 len: 0 microversion: 2.1 time: 0.328578 Aug 10 08:48:10.925796 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 387/763] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:48:10 2022] DELETE /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 08:48:10.934097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:10.934750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:10.945702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.945843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.946249 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:10.947005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:10.947490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:10.947915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:11.094067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:11.101744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a1bb1894-a6e5-4206-9f6f-be04a394688e tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.171514 Aug 10 08:48:11.102320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 377/764] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:10 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:11.129770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1892078868", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15649ad6-aa57-44da-8ef2-51bdc24d542a"}], "security_groups": [{"name": "tempest-securitygroup--1481000651"}], "key_name": "tempest-keypair-377151079", "user_data": "}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:11.233524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] validate_networks() for [('15649ad6-aa57-44da-8ef2-51bdc24d542a', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:48:11.450745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:11.451350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:11.457239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:11.457714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:11.458261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:11.458868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:11.459320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:11.459755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:11.521545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:11.529118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-429f7a96-b2c4-4233-8770-b928a03d76f7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1244 microversion: 2.1 time: 0.082187 Aug 10 08:48:11.531289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 378/765] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:11 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:11.641035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:48:11.641551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:48:11.641966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:48:11.642368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:48:11.642799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:48:11.651790 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:11.652264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:11.652721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:11.653462 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:11.653913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:11.654328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:11.670301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:48:11.674680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Getting quotas for user 661a67fbdd6941889c706d2560c920a2 and project fd42ddf1ccf54e1598b65a08b08774b7. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:48:11.683700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:11.686087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:48:11.689049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:48:11.886058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d7ffd9a0-109c-407a-bd3a-19f945fcd2a3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.761484 Aug 10 08:48:11.887014 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 388/766] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:48:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:48:11.897976 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a3698629-419c-479b-9a39-693eba488b9f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:11.898634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a3698629-419c-479b-9a39-693eba488b9f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:11.958632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a3698629-419c-479b-9a39-693eba488b9f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:11.965795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a3698629-419c-479b-9a39-693eba488b9f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1237 microversion: 2.1 time: 0.071730 Aug 10 08:48:11.966370 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 379/767] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:11 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:12.100331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:12.100803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:12.107003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.107469 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.107898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.108577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.109026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.109445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.122049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:12.122749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:12.130058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.130599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.131018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.131712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.132174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.132597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.135131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:48:12.265317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:12.273655 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f5e32516-086a-406e-a50c-206adb9e7d0d tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.155461 Aug 10 08:48:12.274233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 380/768] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:12 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:12.370674 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dd6c9819-7449-4534-aedc-7ed80931e0cb tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 204 len: 0 microversion: 2.1 time: 0.274190 Aug 10 08:48:12.371294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 389/769] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:48:12 2022] DELETE /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:48:12.379859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:12.390186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:12.390186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.390186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.390186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.390578 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.390578 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.390578 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.515291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:12.523210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f9be7fd2-ba9b-4aa1-bb63-c58b1de71c25 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1553 microversion: 2.1 time: 0.147571 Aug 10 08:48:12.523770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 381/770] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:12 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:12.551113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:12.551824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:12.558113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.558643 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.559086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.559773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.560265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.560731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.621359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:12.629412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a0cc39b9-4392-44be-8a37-09fd31085684 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1244 microversion: 2.1 time: 0.082749 Aug 10 08:48:12.629970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 390/771] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:12 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:12.987189 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:12.987802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:12.990064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:12.994786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.995278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.995714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:12.996407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:12.996894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:12.997320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.058417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:13.066366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1bb426c1-d169-45da-88f5-4b655a36a244 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1241 microversion: 2.1 time: 0.083676 Aug 10 08:48:13.066959 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 382/772] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:12 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:13.295394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:13.295930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:13.302986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.303471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.303906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.304591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.305052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.305478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.433117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:13.440611 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8470571d-cca8-44fc-b9fa-545e1d532be0 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.149175 Aug 10 08:48:13.441174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 391/773] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:13 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:13.544807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:13.545461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:13.552407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.552883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.553312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.553991 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.554439 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.554884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.651055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:13.651802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:13.658413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.658926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.659361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.660050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:13.660504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:13.660930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:13.684450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:13.691933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9e88c491-11e6-4112-9e27-7cbf4d264ded tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1553 microversion: 2.1 time: 0.150977 Aug 10 08:48:13.692503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 383/774] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:13 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:13.725315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:13.732652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d1373536-1897-4a14-ad6d-465287c55157 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1244 microversion: 2.1 time: 0.085744 Aug 10 08:48:13.733212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 392/775] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:13 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:14.087161 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:14.087790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:14.094188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.094779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.095223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.095911 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.096369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.096796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.157473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:14.164884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-06b5d006-fce3-4234-9cb4-82ed8be87b4c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1241 microversion: 2.1 time: 0.081764 Aug 10 08:48:14.165450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 384/776] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:14 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:14.461125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:14.461727 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:14.468409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.468895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.469335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.470057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.470543 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.470973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.602693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:14.610702 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-564701da-c792-4980-98cc-11ed16366a45 tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.152902 Aug 10 08:48:14.611273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 393/777] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:14 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:14.713268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:14.713791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:14.719827 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.720312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.720836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.721524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.721977 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.722403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.753862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:14.754486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:14.760952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.761434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.762135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.762861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:14.763310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:14.763728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:14.828667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:14.836034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2166f0cc-155d-48d3-a689-8b9b0ceb8192 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1244 microversion: 2.1 time: 0.086705 Aug 10 08:48:14.836604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 394/778] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:14 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:14.856503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:14.865268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a66e8e69-8616-4f88-8240-a0e5ba57aad8 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1553 microversion: 2.1 time: 0.156012 Aug 10 08:48:14.865843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 385/779] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:14 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:15.184976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:15.185571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:15.194307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.194821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.195256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.195943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.196392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.196809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.270131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:15.278163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-56ae581f-f56f-4b59-b09f-33d4bb799174 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1233 microversion: 2.1 time: 0.097016 Aug 10 08:48:15.278798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 395/780] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:15 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1233 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:15.631964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:15.632572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:15.639105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.639596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.640067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.640760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.641227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.641654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.778344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:15.786768 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-91c6a8cd-8046-4470-815c-b12fba80ec0c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1521 microversion: 2.1 time: 0.158552 Aug 10 08:48:15.787423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 386/781] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:15 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:15.879787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:15.879787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:15.879787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.879787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.880548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.880548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.880548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.880548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.886601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:15.887505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:15.894144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.895094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.895605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.896410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:15.897011 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:15.897434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:15.948063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:15.957852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c8422216-fcbe-4811-91b3-9e56627a830c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1292 microversion: 2.1 time: 0.104671 Aug 10 08:48:15.973783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 396/782] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:15 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:16.029433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:16.045008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-56080786-2b8b-4942-8c10-131a778f8b74 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1553 microversion: 2.1 time: 0.162310 Aug 10 08:48:16.045853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 387/783] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:15 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:16.150163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c375a801-702c-41d3-8546-9352f517d7fc", "name": "network-vif-deleted", "tag": "f5092e9b-ed55-405f-a0f7-2c55deb94a67"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:16.180073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.180815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.182771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.202969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] Creating event network-vif-deleted:f5092e9b-ed55-405f-a0f7-2c55deb94a67 for instance c375a801-702c-41d3-8546-9352f517d7fc on hv-cinder-78102 Aug 10 08:48:16.213791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-538b686d-326e-4323-9bc7-e757e1c39995 req-4f8e9dfd-a501-4762-a3cb-ecfab866a3d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069508 Aug 10 08:48:16.214935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 397/784] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:16.300062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:16.300670 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:16.309522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.310445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.311035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.312440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.312956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.314163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.395473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:16.404351 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-17cf0684-93e2-45bb-bc95-6dd14caba55e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1297 microversion: 2.1 time: 0.108934 Aug 10 08:48:16.405140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 388/785] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:16 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1297 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:16.810771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:16.812246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:16.820980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.821624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.822157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.823187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.823870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.824558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.857620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.858302 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.858879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.859427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'fault' on Instance uuid c375a801-702c-41d3-8546-9352f517d7fc {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:16.910712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:16.919263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-33b8b7db-c4fb-4b56-928a-f6dcdf64b03a tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1311 microversion: 2.1 time: 0.114136 Aug 10 08:48:16.919878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 398/786] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:16 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:16.979992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:16.980667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:16.987510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.987990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.988422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:16.989105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:16.989557 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:16.990151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.065508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:17.066156 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:17.075736 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.079809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.079809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.079809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.079809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.080273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.113455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.113949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.114387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.115081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lazy-loading 'fault' on Instance uuid 26db3bb7-f656-460d-9c4b-24879a9f3480 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:17.172370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12404366fbba4d1dbb554dcfe65c34d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970da6acbc464dee8191789eec7ba844', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:17.181540 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-54865e35-741d-45ca-8e0c-cb29d2d68aa1 tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 200 len: 1348 microversion: 2.1 time: 0.119888 Aug 10 08:48:17.182407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 399/787] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:17 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 1348 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:17.345224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:17.347998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-45509c4c-6b03-4b3b-9f2d-706a8d5d9ad7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1298 microversion: 2.1 time: 0.372354 Aug 10 08:48:17.348806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 389/788] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:16 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1298 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:17.425811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:17.426251 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:17.436581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.437079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.437659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.438411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.438893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.439323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.591599 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:17.601589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7abb566e-56a4-4dfa-bf4f-12122e6fa558 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.179681 Aug 10 08:48:17.602867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 400/789] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:17 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:17.940642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:17.941797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:17.949258 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.950730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.951523 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.952446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.953228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.954532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.986384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:17.987056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:17.987306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:17.987745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lazy-loading 'fault' on Instance uuid c375a801-702c-41d3-8546-9352f517d7fc {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:18.029397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28b7a7b2e0143cf9ee6e761eb7fb281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c6694dd460a467a986bcaa0e5e000a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:18.036801 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f06e0a90-12ab-4a0e-9245-70e9efd7a21c tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 200 len: 1311 microversion: 2.1 time: 0.100561 Aug 10 08:48:18.037362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 390/790] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:17 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:18.203229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:18.204542 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] [instance: 26db3bb7-f656-460d-9c4b-24879a9f3480] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:18.211367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.212123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.212773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.213654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.214289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.214967 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.230069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] HTTP exception thrown: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. Aug 10 08:48:18.231992 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26db3bb7-f656-460d-9c4b-24879a9f3480", "name": "network-vif-deleted", "tag": "4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Request method failure captured: Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 HTTP/1.1 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82_Mpli9DqrGCqXy792wpKTlxfzuU33CuIxPYxyMMkVqgVbcbMfeCX9m8OJR0scKvReiigC-g5ioWbmrP_794HFx2Y1hAI-hjvAropMn6t_zakO__m7D8Zf3SGjG--v2AfrtsQTK4mb_jwXeVyvDgnwGWANyzuibAWgcDnW1EkrK1pc Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 970da6acbc464dee8191789eec7ba844 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:48:18.232252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/970da6acbc464dee8191789eec7ba844"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/970da6acbc464dee8191789eec7ba844"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/970da6acbc464dee8191789eec7ba844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_970da6acbc464dee8191789eec7ba844", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 970da6acbc464dee8191789eec7ba844 Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-TestMinimumBasicScenario-140243077 Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-TestMinimumBasicScenario-140243077-project Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 12404366fbba4d1dbb554dcfe65c34d9 Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-TestMinimumBasicScenario-140243077-project Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. Aug 10 08:48:18.233532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '26db3bb7-f656-460d-9c4b-24879a9f3480'} Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:18.234258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. Aug 10 08:48:18.235993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:48:18.238455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Returning 404 to user: Instance 26db3bb7-f656-460d-9c4b-24879a9f3480 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:18.239607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7c705e19-c615-4ca7-8058-eab07c1b5e2b tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480" status: 404 len: 111 microversion: 2.1 time: 0.040205 Aug 10 08:48:18.240372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 401/791] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:18 2022] GET /compute/v2.1/servers/26db3bb7-f656-460d-9c4b-24879a9f3480 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:18.243716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.244952 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.245923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.248886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-915b40ef-f3a4-4c09-bf0d-257c6f9c77ee tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] Calling method '.version_select at 0x7fdef57d4040>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:18.269461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] Creating event network-vif-deleted:4cd02885-fb98-4b6d-8aa2-f94f8db6f9d5 for instance 26db3bb7-f656-460d-9c4b-24879a9f3480 on hv-cinder-78102 Aug 10 08:48:18.274905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-92962a3c-9b76-4575-a4a9-b37ca8020f1f req-c0a24c51-77b7-49dd-aadb-5cfbc56e0001 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046176 Aug 10 08:48:18.275760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 391/792] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:18.372057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:18.372057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:18.378929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.379634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.379944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.380640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.381252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.381682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.385966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:18.392954 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-915b40ef-f3a4-4c09-bf0d-257c6f9c77ee tempest-TestMinimumBasicScenario-140243077 tempest-TestMinimumBasicScenario-140243077-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463797268" status: 202 len: 0 microversion: 2.1 time: 0.148036 Aug 10 08:48:18.401754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 402/793] 10.222.0.45 () {58 vars in 1269 bytes} [Wed Aug 10 08:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-463797268 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:48:18.401754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6cfec-568b-48f0-8921-cf60a016e438", "tag": "7e14fb21-e61d-4a26-b59f-5532a3bd98dc"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:18.413875 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.414795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.415331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.429481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] Creating event network-changed:7e14fb21-e61d-4a26-b59f-5532a3bd98dc for instance 77f6cfec-568b-48f0-8921-cf60a016e438 on hv-cinder-78102 Aug 10 08:48:18.436237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-005d13d8-3925-4457-be48-2e2ec6d54b3b req-4dca4e1a-b654-4439-b3af-54c37bd92226 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 Aug 10 08:48:18.437894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 403/794] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:18.591300 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:18.600856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-39c99e32-0349-4555-affc-1f720528e8f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.235399 Aug 10 08:48:18.604222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 392/795] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:18 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:18.623859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:18.624077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:18.633025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.633732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.634381 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.635120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:18.636200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:18.636962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:18.669214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:18.858913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:18.868760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b8cdc1d8-301f-4d0a-a27a-9fb219949c1d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.249698 Aug 10 08:48:18.869378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 404/796] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:18 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:19.057805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:19.058540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] [instance: c375a801-702c-41d3-8546-9352f517d7fc] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:19.066213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.066994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.067876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:19.068876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.069876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.070851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] HTTP exception thrown: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Request method failure captured: Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc HTTP/1.1 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829I0s8OLLd7kgYfQFsl1J1623noD67FD3sKctS7l0sDbxkw2bLNMkm4Gl7WZJOLtHfWtrg77e-tt47ew0CT7Gj2wgE5jDAaqLZzWzK8_vEjzgsw_k2syerqtpJMzWGToUkn_ddLyOOz7AgqW3rAA5u_P7tMgqIgyNeptsV1BWQzvs4 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:48:19.090444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5c6694dd460a467a986bcaa0e5e000a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5c6694dd460a467a986bcaa0e5e000a9", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 5c6694dd460a467a986bcaa0e5e000a9 Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043383899 Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: d28b7a7b2e0143cf9ee6e761eb7fb281 Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043383899-project Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. Aug 10 08:48:19.092203 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'c375a801-702c-41d3-8546-9352f517d7fc'} Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:19.093108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. Aug 10 08:48:19.095614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:19.097103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] Returning 404 to user: Instance c375a801-702c-41d3-8546-9352f517d7fc could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:19.097103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c3fb9433-662c-4066-9b24-c1ff92b3026f tempest-ServerRescueNegativeTestJSON-2043383899 tempest-ServerRescueNegativeTestJSON-2043383899-project] 10.222.0.45 "GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc" status: 404 len: 111 microversion: 2.1 time: 0.038421 Aug 10 08:48:19.097103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 393/797] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:19 2022] GET /compute/v2.1/servers/c375a801-702c-41d3-8546-9352f517d7fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:19.622666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:19.623277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:19.631382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.631874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.632314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:19.633003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.633459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.633881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:19.770782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:19.780433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3ba131d9-fabf-49ad-b9f8-dd43ff56149d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.161695 Aug 10 08:48:19.781093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 405/798] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:19 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:19.889251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:19.889776 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:19.891686 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:19.896442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.896929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.897372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:19.898072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:19.898555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:19.898985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:20.217256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:20.225895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-50d2f657-2972-4a4e-a021-cb986d9fd65c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.340550 Aug 10 08:48:20.226477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 394/799] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:19 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:20.292685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f2033c-38d9-4a6b-bd49-66e788022276", "tag": "2d2c58b3-531d-478a-ae7a-5e94de0cbd39"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:20.302646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:20.303117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:20.303537 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:20.315071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] Creating event network-changed:2d2c58b3-531d-478a-ae7a-5e94de0cbd39 for instance 03f2033c-38d9-4a6b-bd49-66e788022276 on hv-cinder-78102 Aug 10 08:48:20.319811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-5cc803b6-fdeb-497b-b28b-f47134afcc44 req-8816fd51-018c-496a-9bf5-7fab18d0fb52 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Aug 10 08:48:20.320399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 406/800] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:20.801478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:20.802382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:20.809023 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:20.809594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:20.810057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:20.810980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:20.811441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:20.811947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:21.248624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:21.249394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:21.251421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:21.259663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-71bb62ed-6afe-48c5-b2a6-dce3de36c85d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.462256 Aug 10 08:48:21.260242 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 395/801] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:20 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:21.282613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:21.283430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:21.283976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:21.284817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:21.285348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:21.285785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:21.492715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:21.502144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-38cfc41a-13f4-4264-aed5-1083158c6e1c tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.256996 Aug 10 08:48:21.502891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 407/802] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:21 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:22.282373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:22.283018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:22.285753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=12 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:22.291802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:22.292474 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:22.293062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:22.293919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:22.295562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:22.295562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:22.530545 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:22.532498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:22.534624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:22.537673 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=12 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:22.551853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:22.552362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:22.557059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:22.559531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:22.560948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:22.561846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:22.562508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:22.574188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0b9768c9-fb6d-4254-b6a6-0c9b7bb2c43f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.294718 Aug 10 08:48:22.587955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 396/803] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:22 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:22.868388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:22.877170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6810d5d6-b283-4814-8380-824566efac7a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.357621 Aug 10 08:48:22.877979 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 408/804] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:22 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:23.597109 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:23.598453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:23.611284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:23.611909 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:23.612579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:23.613379 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:23.614292 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:23.614809 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:23.850504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:23.859623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c684d720-37fd-42cf-849f-ac1d229860f2 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.267570 Aug 10 08:48:23.861099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 397/805] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:23 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:23.901163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:23.902624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:23.917391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:23.918050 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:23.918744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:23.919628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:23.920290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:23.920956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:24.287045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:24.296942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-961a0fcc-6c5c-4d29-8f84-0f581e011fae tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.401042 Aug 10 08:48:24.300610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 409/806] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:23 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:24.886552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:24.892888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:24.899826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:24.900900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:24.901692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:24.902908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:24.903792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:24.904390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:25.083398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:25.092532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9df5ae18-1187-45ee-a9dc-34d60b10994e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.213196 Aug 10 08:48:25.096355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 398/807] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:24 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:25.321299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:25.321988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:25.329951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:25.330437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:25.330952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:25.331703 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:25.332300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:25.333086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:25.517268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:25.527946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-40a96a6e-0a2d-44b1-bf6d-acc5e8e80836 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.210429 Aug 10 08:48:25.528905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 410/808] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:25 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:25.602090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f2033c-38d9-4a6b-bd49-66e788022276", "name": "network-vif-plugged", "status": "completed", "tag": "2d2c58b3-531d-478a-ae7a-5e94de0cbd39"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:25.612898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:25.613325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:25.613760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:25.627720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] Creating event network-vif-plugged:2d2c58b3-531d-478a-ae7a-5e94de0cbd39 for instance 03f2033c-38d9-4a6b-bd49-66e788022276 on hv-cinder-78102 Aug 10 08:48:25.633121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-8e1282df-3a6e-47ae-8f1e-5a1c70ea26ad req-a022419b-546e-4710-b1dc-41baabe34d78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036604 Aug 10 08:48:25.634005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 399/809] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:26.117320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:26.117949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:26.125752 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:26.126764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:26.127700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:26.129147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:26.130009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:26.130735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:26.294235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:26.302125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-26c88f7e-e51a-44f6-8de3-9cc322f437a3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.189899 Aug 10 08:48:26.302731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 411/810] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:26 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:26.551090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:26.551955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:26.558861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:26.559425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:26.560140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:26.560913 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:26.561459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:26.562122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:26.741462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:26.751437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8c282254-94a9-486f-baa4-0284290b2fe8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.205770 Aug 10 08:48:26.752770 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 400/811] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:26 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:27.331676 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:27.332287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:27.346240 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:27.347043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:27.347496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:27.348316 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:27.350940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:27.351400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:27.560807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:27.577140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f4c1d745-c532-428b-ae03-1e8f9ddb1dfe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1366 microversion: 2.1 time: 0.250833 Aug 10 08:48:27.583367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 412/812] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:27 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:27.649845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6cfec-568b-48f0-8921-cf60a016e438", "name": "network-vif-plugged", "status": "completed", "tag": "7e14fb21-e61d-4a26-b59f-5532a3bd98dc"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:27.679494 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:27.679920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:27.680499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:27.702505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] Creating event network-vif-plugged:7e14fb21-e61d-4a26-b59f-5532a3bd98dc for instance 77f6cfec-568b-48f0-8921-cf60a016e438 on hv-cinder-78102 Aug 10 08:48:27.720247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-6909ab41-1384-4f13-81da-c08cdef4bf1e req-0ac7ea31-820a-4e0e-af36-9a2839cb45c7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073830 Aug 10 08:48:27.720983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 401/813] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:27.776605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:27.777488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:27.787679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:27.788305 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:27.788860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:27.789753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:27.790201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:27.791423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:28.002571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:28.014874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b4a25d06-8ef5-4aa0-95bd-59eb458e55b7 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.245376 Aug 10 08:48:28.016585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 413/814] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:27 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:28.602972 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:28.603692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:28.609842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:28.614456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:28.614456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:28.614456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:28.614456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:28.615012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:28.751095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:28.758635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-43fb221a-f4c5-4f01-9b2b-78b23dea07d7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1556 microversion: 2.1 time: 0.160336 Aug 10 08:48:28.759446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 402/815] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:28 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:28.789714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:28.789714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:28.820995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:28.827098 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:28.832524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:28.832524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:28.832524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:28.832524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:28.945583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e2840cdf-6d33-402b-b85d-857c18a3f5a6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164212 Aug 10 08:48:28.952886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 414/816] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:48:28 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:29.037284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:29.037893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:29.045091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:29.046198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:29.046861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:29.047819 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:29.048375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:29.048979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:29.389137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:29.397245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2a59476d-845c-4708-8b07-846b984301b3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.364022 Aug 10 08:48:29.397894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 403/817] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:29 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:30.419209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:30.419800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:30.430664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:30.431260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:30.431768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:30.432548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:30.433102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:30.433570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:30.623622 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f2033c-38d9-4a6b-bd49-66e788022276", "tag": "2d2c58b3-531d-478a-ae7a-5e94de0cbd39"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:30.634117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:30.634634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:30.635060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:30.649595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] Creating event network-changed:2d2c58b3-531d-478a-ae7a-5e94de0cbd39 for instance 03f2033c-38d9-4a6b-bd49-66e788022276 on hv-cinder-78102 Aug 10 08:48:30.656625 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-2383a9f9-2afb-4003-8974-60f3b667142d req-8bd0e4a5-12c2-4456-aa63-a343eb003c5c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Aug 10 08:48:30.657381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 404/818] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:30.706574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:30.715317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a944ca6a-63d2-4b9a-919a-444b5923c0dd tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1363 microversion: 2.1 time: 0.300530 Aug 10 08:48:30.724721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 415/819] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:30 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:31.737325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:31.737945 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:31.746456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:31.747032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:31.747784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:31.753049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:31.755542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:31.755542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:31.940671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:31.949190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-23a38ba0-cd12-48f1-b943-d9db2561c30f tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1548 microversion: 2.1 time: 0.216657 Aug 10 08:48:31.949812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 405/820] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:31 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:31.971758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:31.977771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:31.980472 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:31.981154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:31.981773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:31.982708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:31.983381 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:31.983988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:32.117698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2de23da8-7cc2-4c7f-ae92-7356e773c7e3 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151368 Aug 10 08:48:32.118963 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 416/821] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:48:31 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:33.318158 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6cfec-568b-48f0-8921-cf60a016e438", "tag": "7e14fb21-e61d-4a26-b59f-5532a3bd98dc"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:33.328383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:33.329108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:33.329990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:33.344696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] Creating event network-changed:7e14fb21-e61d-4a26-b59f-5532a3bd98dc for instance 77f6cfec-568b-48f0-8921-cf60a016e438 on hv-cinder-78102 Aug 10 08:48:33.355246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-f5a30ce1-5e2a-4f2e-abf4-3238f9868407 req-5aa5973b-2773-463a-9006-4f7fbb5b0117 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040558 Aug 10 08:48:33.356113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 406/822] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:48:50.069976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:50.070765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=66 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:50.074682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:50.075173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:50.080920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:50.081399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:50.081838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:50.082545 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:50.083004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:50.083429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:50.108415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:48:50.370930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-297db45f-e2ea-4543-b05e-789f73e2e2c1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 204 len: 0 microversion: 2.1 time: 0.301822 Aug 10 08:48:50.371532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 417/823] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:48:50 2022] DELETE /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:48:50.380267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:50.380986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:50.383666 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=51 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:50.384320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=68 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:48:50.389214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:50.389700 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:50.390142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:50.390863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:50.391328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:50.392256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:50.528391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:50.536836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b0698f82-e256-425b-96f6-94322df4ce70 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1578 microversion: 2.1 time: 0.160779 Aug 10 08:48:50.539837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 407/824] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:50 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:48:51.559000 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:51.559687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:51.566392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:51.566928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:51.567358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:51.568044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:51.568494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:51.568909 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:51.704991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:51.712556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dd982a3b-af5a-413c-a7f7-30d454cd54b2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1578 microversion: 2.1 time: 0.157856 Aug 10 08:48:51.713128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 418/825] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:51 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:52.733707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:52.734446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:52.741822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:52.742563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:52.742999 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:52.743683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:52.744331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:52.744887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:52.990175 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:52.998206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4ae146b7-8e82-4102-838e-65717b4b2399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1578 microversion: 2.1 time: 0.268759 Aug 10 08:48:52.998819 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 408/826] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:52 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:53.897168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca6145f-1018-4b81-9e0c-9813a80b229f", "name": "network-vif-deleted", "tag": "40ce47d6-49b6-4015-86c9-80332239af72"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:53.907221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:53.907694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:53.908118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:53.920514 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] Creating event network-vif-deleted:40ce47d6-49b6-4015-86c9-80332239af72 for instance 2ca6145f-1018-4b81-9e0c-9813a80b229f on hv-cinder-78102 Aug 10 08:48:53.925368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-f54c46bd-7bed-48b8-a6eb-19d8b42670be req-086b86ab-3c90-41a8-857c-591677fa9a19 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Aug 10 08:48:53.925968 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 419/827] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:48:54.020806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:54.022386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:54.029510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:54.035214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:54.035214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:54.035214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:54.035214 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:54.035876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:54.120561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:54.129451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3d45f0da-dcd7-41b1-a429-cd40a431237e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1510 microversion: 2.1 time: 0.112848 Aug 10 08:48:54.130896 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 409/828] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:54 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1510 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:55.152052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:55.152666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:55.158855 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:55.160117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:55.160117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:55.160476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:55.161119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:55.161544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:55.200357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:55.200838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:55.201275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:55.201918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid 2ca6145f-1018-4b81-9e0c-9813a80b229f {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:48:55.247728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:55.257885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-be828f6d-6899-44dc-96da-7783f1dc5085 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 200 len: 1230 microversion: 2.1 time: 0.110981 Aug 10 08:48:55.258857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 420/829] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:55 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:56.280062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:56.280602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:56.286961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:56.292462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:56.292462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:56.292462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:56.292462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:56.292847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:56.304274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] HTTP exception thrown: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Request method failure captured: Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f HTTP/1.1 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83APqqazqZG-xlWG-KhcNcJtzvVhjkIalWdP1vTUt1JPrr5d7yS0Ks-fXpFD_SH-S8Ugz_-LM348e9IxOSMXLbS6ge67g-tiJVmAl5JMRNZaX7OgkkYRsac9hC8rYT8aztlxUIk5f-VPtAQYn7PY7uv96XpZMoP1xCtG61rCLpAz9Ck Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:48:56.305881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3230d51d63a4f9a9d47624c553242f4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-TestVolumeBootPattern-48175985 Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: f1c7a90e90e5411f92eddd180ef9e27d Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:48:56.307554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '2ca6145f-1018-4b81-9e0c-9813a80b229f'} Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:48:56.308673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:48:56.310294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:48:56.311677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Returning 404 to user: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:48:56.311677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e12e380e-bff6-41af-97e5-cdfffa53c964 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 404 len: 111 microversion: 2.1 time: 0.031246 Aug 10 08:48:56.311677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 410/830] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:56 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:48:56.406440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1818963296", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993683958", "security_groups": [{"name": "tempest-secgroup-smoke-1632375263"}], "block_device_mapping_v2": [{"uuid": "4730382e-9e04-48c1-a31a-706fe1c2fd5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36df5925-02bb-4ea1-8602-8c8a2eea5405"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:48:56.530272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] validate_networks() for [('36df5925-02bb-4ea1-8602-8c8a2eea5405', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:48:57.222280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:48:57.222726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:48:57.223197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:48:57.223680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:48:57.224077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:48:57.232918 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:57.233390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:57.233818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:57.234555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:57.235046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:57.235463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:57.251804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:48:57.255697 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for user f1c7a90e90e5411f92eddd180ef9e27d and project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:48:57.312236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:48:57.314331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4730382e-9e04-48c1-a31a-706fe1c2fd5d',volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:48:57.817866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0440caae-fab5-4d15-b6b3-1e047cf0d6a2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.415296 Aug 10 08:48:57.824371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 421/831] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:48:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:48:57.830421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cd74398a-6589-4858-b25a-6d48ce9b64e1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:57.831052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cd74398a-6589-4858-b25a-6d48ce9b64e1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:57.885568 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cd74398a-6589-4858-b25a-6d48ce9b64e1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:57.892414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cd74398a-6589-4858-b25a-6d48ce9b64e1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1094 microversion: 2.1 time: 0.066542 Aug 10 08:48:57.893224 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 411/832] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:57 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:48:58.914367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:48:58.915006 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:48:58.921112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:58.921600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:58.922039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:58.922760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:48:58.923221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:48:58.923646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:48:58.986248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:48:58.994835 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3c9939eb-ff31-4973-9d82-f6e30b1a40ce tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1144 microversion: 2.1 time: 0.084727 Aug 10 08:48:58.995406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 422/833] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:48:58 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:00.017719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:00.018422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:00.187487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:00.188033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:00.188467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:00.189177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:00.189638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:00.190066 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:00.264691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:00.273147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1cbcb99d-74a9-4634-962d-74b650070399 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1210 microversion: 2.1 time: 0.260787 Aug 10 08:49:00.273958 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 412/834] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:00 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1210 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:01.294071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:01.302553 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:01.310832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:01.311317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:01.317813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:01.317813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:01.317813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:01.317813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:01.458425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:01.466057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5d8a9db2-c10d-48e4-a285-e9d6ee678ff1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1278 microversion: 2.1 time: 0.175952 Aug 10 08:49:01.466656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 423/835] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:01 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:01.744335 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b82cda-225a-419d-baf9-879e64f0e070", "tag": "f4903dd7-3b50-4fe0-9c5d-5d712f213d49"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:49:01.758930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:01.759293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:01.759708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:01.771851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] Creating event network-changed:f4903dd7-3b50-4fe0-9c5d-5d712f213d49 for instance a7b82cda-225a-419d-baf9-879e64f0e070 on hv-cinder-78102 Aug 10 08:49:01.777478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-3400ceec-f41c-4ab2-871d-c4500fbc23df req-b9a1534f-93d9-4a01-b9c2-504c437c7197 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Aug 10 08:49:01.778076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 413/836] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:49:02.487566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:02.488179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:02.494295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:02.494805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:02.495276 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:02.495970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:02.496433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:02.496861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:02.689829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:02.697441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6db9d50e-39c7-43c1-b0d9-6026f34468c2 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.214412 Aug 10 08:49:02.698016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 424/837] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:02 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:03.720364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:03.721091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:03.727169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:03.727657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:03.728097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:03.728792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:03.729257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:03.729689 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:03.862710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:03.870326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c13565ab-425d-4e07-9c36-a84123e93d2e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.154535 Aug 10 08:49:03.871122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 414/838] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:03 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:04.891344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:04.891962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:04.898309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:04.898830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:04.899609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:04.900221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:04.900683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:04.901110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:05.043679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:05.052007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1d65cc99-46c9-4024-aef9-636cb0a7d3e9 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.164470 Aug 10 08:49:05.052575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 425/839] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:04 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:06.071461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:06.072064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:06.078614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:06.079284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:06.079728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:06.081063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:06.081391 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:06.081759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:06.215365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:06.223375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-24378955-9f33-4662-af53-a6434d2bb320 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.155831 Aug 10 08:49:06.223914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 415/840] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:06 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:07.243664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:07.244265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:07.246714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:07.251485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:07.251992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:07.252427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:07.253113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:07.253566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:07.253990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:07.270402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:07.540123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:07.547614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6c1c4335-482a-4eb8-ba75-6ba6617968b4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.307802 Aug 10 08:49:07.553571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 426/841] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:07 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:08.569793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:08.570516 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:08.573113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:08.578493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:08.579022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:08.579471 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:08.580183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:08.580644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:08.581074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:08.713717 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:08.721916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-79d8bace-0706-4b41-8e39-72bc12eb610b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.156052 Aug 10 08:49:08.722481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 416/842] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:08 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:09.743574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:09.744116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:09.750729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:09.751313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:09.751849 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:09.752630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:09.753181 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:09.753618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:09.895111 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:09.903752 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-85e9ba8d-c203-4684-92e4-d17e8e4264a8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.165167 Aug 10 08:49:09.904574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 427/843] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:09 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:10.925868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:10.927051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:10.933648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:10.934139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:10.934610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:10.935312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:10.935769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:10.936279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:11.071683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:11.079459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b3e4da1a-6b46-4af8-a2e5-62841a16578d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.157377 Aug 10 08:49:11.080050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 417/844] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:10 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:12.099707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:12.100339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:12.107086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:12.107562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:12.108001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:12.108678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:12.109128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:12.109548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:12.245185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:12.252552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6ce11068-adeb-4734-8908-9155a6a55351 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.156703 Aug 10 08:49:12.253307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 428/845] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:12 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:13.274832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:13.275382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:13.281765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:13.282251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:13.282713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:13.283400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:13.283855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:13.284288 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:13.416051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:13.423825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6c3bc238-b671-433b-b6c6-fba0ef6ec858 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.153728 Aug 10 08:49:13.424298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 418/846] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:13 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:13.601976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b82cda-225a-419d-baf9-879e64f0e070", "name": "network-vif-plugged", "status": "completed", "tag": "f4903dd7-3b50-4fe0-9c5d-5d712f213d49"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:49:13.612040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:13.612556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:13.613175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:13.625158 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] Creating event network-vif-plugged:f4903dd7-3b50-4fe0-9c5d-5d712f213d49 for instance a7b82cda-225a-419d-baf9-879e64f0e070 on hv-cinder-78102 Aug 10 08:49:13.631216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-86004e92-5181-4d0e-999f-94666ac82917 req-1a2b2edb-070a-4f6a-8bfa-0efef5c2fbb9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Aug 10 08:49:13.631816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 429/847] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:49:14.445029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:14.445644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:14.452309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:14.452793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:14.453230 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:14.453923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:14.454389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:14.454840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:14.586694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:14.594121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-49d6c618-d122-4065-9c9d-3f39345e36ef tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.153636 Aug 10 08:49:14.594711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 419/848] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:14 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:15.616264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:15.616980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:15.623192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:15.623671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:15.624102 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:15.624782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:15.625233 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:15.625655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:15.755438 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:15.763355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-75a9d383-2df7-4f58-91c1-5cb9363e1566 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1266 microversion: 2.1 time: 0.151771 Aug 10 08:49:15.763911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 430/849] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:15 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:16.784152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:16.784764 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:16.791744 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:16.792222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:16.792661 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:16.793346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:16.793805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:16.794229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:16.920297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:16.927897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1abfebda-d8dc-48b7-96f4-2cc522b7f655 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1453 microversion: 2.1 time: 0.147544 Aug 10 08:49:16.928456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 420/850] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:16 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:16.947798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:16.948407 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:16.954877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:16.955355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:16.955786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:16.956499 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:16.956950 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:16.957369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:17.089941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:17.097456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e468f60a-1b73-4616-b685-a624c3ed3c0b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1453 microversion: 2.1 time: 0.153952 Aug 10 08:49:17.098025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 431/851] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:49:16 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:49:19.036251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b82cda-225a-419d-baf9-879e64f0e070", "tag": "f4903dd7-3b50-4fe0-9c5d-5d712f213d49"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:49:19.046709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:19.047191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:19.047624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:19.059138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] Creating event network-changed:f4903dd7-3b50-4fe0-9c5d-5d712f213d49 for instance a7b82cda-225a-419d-baf9-879e64f0e070 on hv-cinder-78102 Aug 10 08:49:19.064060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-0d0c32c0-ea65-4b79-8323-8e631a2455ee req-82cb0723-496c-4f08-bb4d-b9e07134e90a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031591 Aug 10 08:49:19.064673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 421/852] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:49:29.890333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:29.890965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:29.893431 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:29.894096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:29.899006 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:29.899487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:29.899920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:29.900609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:29.901061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:29.901985 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:29.925280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a9c8a6d6-ac33-4035-ace4-925f8a8e0d76 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/ips" status: 200 len: 151 microversion: 2.20 time: 0.038760 Aug 10 08:49:29.926080 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 432/853] 10.222.0.45 () {60 vars in 1289 bytes} [Wed Aug 10 08:49:29 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:49:37.290394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=32 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:37.291157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=72 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:49:37.295251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:49:37.295869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:37.301705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:37.312186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:37.312186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:37.312186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:37.312186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:37.312579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:37.326059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lazy-loading 'flavor' on Instance uuid d0bae61f-bd65-476a-bfbb-e9a87ecef39a {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:49:37.753809 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-63a35f75-b9d6-4a46-ada4-4376ea9ae786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/action" status: 202 len: 0 microversion: 2.20 time: 0.464743 Aug 10 08:49:37.754440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 422/854] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 08:49:37 2022] POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:49:37.763043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:37.763653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:37.771153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:37.771640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:37.772148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:37.775195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:37.775195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:37.775195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:37.906845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:37.914760 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:37.916266 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:37.917955 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8f70645b-6740-4960-99ff-8612f7e0236a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.159106 Aug 10 08:49:37.918589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 433/855] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:37 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:38.942114 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:38.942811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:38.950639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:38.951117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:38.951544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:38.952223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:38.952677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:38.953095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:39.084004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:39.091859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:39.093337 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:39.094502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ba6ff037-777d-4208-a1b9-f676a7826df5 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.157126 Aug 10 08:49:39.095050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 423/856] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:38 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:40.117421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:40.118056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:40.125879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:40.126369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:40.126861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:40.127558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:40.128019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:40.128446 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:40.262305 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:40.270269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:40.271856 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:40.273027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dd57483d-cbda-47d1-b85b-26ac1467a0bd tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.159894 Aug 10 08:49:40.273844 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 434/857] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:40 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:41.295886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:41.296422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:41.302818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:41.303297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:41.303732 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:41.304408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:41.304855 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:41.305275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:41.428980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:41.437220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:41.438751 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:41.439894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cccc50c9-cda5-45dd-b753-620b85850072 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.148094 Aug 10 08:49:41.440445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 424/858] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:41 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:42.463124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:42.464433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:42.471022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:42.471507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:42.472546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:42.473247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:42.474188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:42.474188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:42.604185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:42.612221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:42.613758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:42.614943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b879875b-7400-4468-a53e-320582d6ce6f tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.155831 Aug 10 08:49:42.615498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 435/859] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:42 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:43.638454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:43.639012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:43.645278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:43.645750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:43.646181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:43.646893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:43.647344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:43.647765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:43.776766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:43.784749 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:43.786280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:43.787467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c2d775a1-32b3-4b05-bc17-8960acdd7246 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.152952 Aug 10 08:49:43.788017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 425/860] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:43 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:44.809780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:44.810388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:44.816761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:44.817245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:44.817679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:44.818362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:44.818845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:44.819270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:44.946203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:44.954057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:44.955590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:44.956785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-596658d0-be00-47f7-9c08-eb464341fd38 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.151603 Aug 10 08:49:44.957335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 436/861] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:44 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:45.980600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:45.981206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:45.987561 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:45.988041 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:45.988477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:45.989162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:45.989618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:45.990043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:46.119339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:46.127708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:46.129222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:46.130362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-46e81337-a1ed-42a4-9cd3-fe46ea79e528 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.154275 Aug 10 08:49:46.130937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 426/862] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:45 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:47.153244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:47.153843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:47.160126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:47.160606 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:47.161036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:47.161714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:47.162169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:47.162629 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:47.292740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:47.300676 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:47.302172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:47.303365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-65299659-ffd9-4632-b001-d8c79568f6d3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.154226 Aug 10 08:49:47.303934 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 437/863] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:47 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:48.327225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:48.327761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:48.334202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:48.334729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:48.335171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:48.335860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:48.336319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:48.336748 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:48.461735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:48.470294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:48.471829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:48.472989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-753da6f8-817c-4f9e-858c-cb8b1de06051 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.150357 Aug 10 08:49:48.473746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 427/864] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:48 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:49.496014 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:49.496740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:49.503501 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:49.504012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:49.504593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:49.505364 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:49.505827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:49.506540 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:49.632653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:49.640432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:49.644713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:49.644713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bcb0a0ed-81d3-40e8-ac16-d6aa09fb832b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.151033 Aug 10 08:49:49.644713 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 438/865] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:49 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:50.666526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:50.667068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:50.673919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:50.674392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:50.674859 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:50.675533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:50.675984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:50.676406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:50.807961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:50.816540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:50.818026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:50.819206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-11a695e2-1f1f-4e7c-b224-14d703c547a8 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.156647 Aug 10 08:49:50.819755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 428/866] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:50 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:51.841942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:51.842629 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:51.849272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:51.849755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:51.850184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:51.850887 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:51.851341 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:51.851815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:51.985299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:51.993112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:51.995490 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:51.995785 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-af84ea42-53aa-42d2-98dc-315f9e9df854 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.157864 Aug 10 08:49:51.996931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 439/867] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:51 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:53.019646 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:53.020252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:53.026874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:53.027353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:53.027786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:53.028467 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:53.028920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:53.029343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:53.158654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:53.166746 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:53.168267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:53.169446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1ebb93ef-36f5-444e-bf0b-1c7a75075a00 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.153660 Aug 10 08:49:53.170035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 429/868] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:53 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:54.191203 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:54.191807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:54.198168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:54.198631 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:54.199067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:54.199762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:54.200217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:54.200643 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:54.334061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:54.342455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:54.344613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:54.346053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f66c3deb-71ee-4636-a6f5-2cf18d789285 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.158669 Aug 10 08:49:54.346908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 440/869] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:54 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:55.369142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:55.369777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:55.376322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:55.376804 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:55.377243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:55.377929 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:55.378384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:55.378845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:55.507055 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:55.515501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:55.516939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:55.518137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7728592d-46a8-4e88-aa2b-288bf30a9539 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.152934 Aug 10 08:49:55.518738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 430/870] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:55 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:56.542886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:56.543622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:56.550860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:56.551379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:56.551815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:56.552495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:56.552947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:56.553364 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:56.689125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:56.696300 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:56.697798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:56.698999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2253230b-1e60-4aa0-9a61-72ab5e7e09eb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.160056 Aug 10 08:49:56.699560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 441/871] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:56 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:57.721127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:57.721857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:57.727853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:57.728332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:57.728766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:57.729478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:57.729928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:57.730348 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:57.832279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "name": "network-vif-plugged", "status": "completed", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:49:57.842657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:57.843135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:57.843562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:57.854176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] Creating event network-vif-plugged:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:49:57.859850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-b9c4ca85-cf50-4cc0-aa9c-56483fc2856f req-20102468-4415-419a-97d2-339ce0f1484f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Aug 10 08:49:57.860444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 442/872] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:49:57.860594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:57.868766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:57.870267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:57.871447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-812e7392-cbc5-4366-986b-ad1d6936d08d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.154225 Aug 10 08:49:57.871989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 431/873] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:57 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:49:58.895920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:49:58.896623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:49:58.902951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:58.903436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:58.903875 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:58.904563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:49:58.905025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:49:58.905456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:49:59.033390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:59.041304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:59.043171 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:49:59.044138 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6294c8cd-ae3d-4be9-9ac3-1420ddb921cc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.152897 Aug 10 08:49:59.044712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 443/874] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:49:58 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:00.068632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:00.069163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:00.075352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:00.075831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:00.076263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:00.076941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:00.077892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:00.078315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:00.208081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:00.215953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:00.217480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:00.219311 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e556d67f-d7c0-4673-88c9-435b5cddf040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.154578 Aug 10 08:50:00.219871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 432/875] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:00 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:01.242675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:01.243284 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:01.249809 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:01.250295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:01.250761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:01.251447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:01.251903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:01.252332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:01.385811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:01.394110 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:01.395613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:01.396876 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b0e7ef75-7e5b-429c-a258-04ee8b3a5eff tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1743 microversion: 2.20 time: 0.158094 Aug 10 08:50:01.397423 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 444/876] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:01 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:02.420222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:02.421508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:02.428006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:02.428895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:02.429009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:02.429653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:02.430105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:02.430555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:02.649200 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:02.660936 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:02.664378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:02.664378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-641f46c9-82d9-4c73-81bf-35e0be212a5a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.247218 Aug 10 08:50:02.664378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 433/877] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:02 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:03.688285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:03.689541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:03.700725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:03.701471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:03.702062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:03.702995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:03.703607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:03.704609 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:03.900148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:03.911992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:03.913829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:03.915319 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-37d00245-9c2e-45f7-a3b6-013e8cdd8855 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.230967 Aug 10 08:50:03.916121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 445/878] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:03 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:04.938105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:04.939451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:04.946077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:04.946581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:04.947177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:04.948059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:04.948669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:04.949245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:05.144279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:05.153970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:05.156060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:05.157588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5690ec05-19ca-4d3e-b0d7-5ec72f145672 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.223373 Aug 10 08:50:05.158375 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 434/879] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:04 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:06.180805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:06.181458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:06.188291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:06.189100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:06.189893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:06.190872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:06.191545 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:06.192205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:06.397019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:06.406405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:06.408299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:06.409527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e446100f-c1e3-4f06-b6df-8579301e0cab tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.232771 Aug 10 08:50:06.410296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 446/880] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:06 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:07.445386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:07.447295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:07.456659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=27 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:07.461136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:07.461974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:07.462637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:07.466650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:07.466650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:07.466650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:07.502219 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:07.723777 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:07.754756 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:07.770484 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:07.775710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-200913f1-125a-460d-bc24-919b70f5acfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.335979 Aug 10 08:50:07.780918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 435/881] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:07 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:08.806637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:08.808106 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:08.824337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:08.825104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:08.825733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:08.826669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:08.827859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:08.830146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:09.066392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:09.078597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:09.080648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:09.088665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0ee998d9-5e7c-45b2-bdee-1132d28b7f10 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.279516 Aug 10 08:50:09.088665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 447/882] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:08 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:10.109849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:10.110356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:10.118295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:10.118811 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:10.119332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:10.120026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:10.120478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:10.120901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:10.122700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:10.123197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:10.126173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=33 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:10.132443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:10.132936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:10.133370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:10.134085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:10.134552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:10.134980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:10.137604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=91 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:10.163961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-52429bd0-a4c5-43ae-8bd7-c608a3b01422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/ips" status: 200 len: 149 microversion: 2.1 time: 0.045058 Aug 10 08:50:10.165086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 448/883] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:50:10 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:50:10.276215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:10.287192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:10.289127 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:10.291220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a7b0324f-35bd-47c1-b326-52ca78cbd3c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.186145 Aug 10 08:50:10.295334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 436/884] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:10 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:11.320788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:11.321564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:11.329267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:11.329747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:11.330385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:11.331271 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:11.331881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:11.332463 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:11.504802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:11.515382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:11.516978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:11.518310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ff3d0990-319d-48de-afde-292d8f81ecd2 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.201937 Aug 10 08:50:11.519084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 449/885] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:11 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:12.340534 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:12.341995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:12.357853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:12.357853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:12.357853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:12.366694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:12.367465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:12.368885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:12.423668 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f0030049-542d-41d9-a74b-046c0e6f1c0e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/ips" status: 200 len: 144 microversion: 2.1 time: 0.087396 Aug 10 08:50:12.424259 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 437/886] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:50:12 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/ips => generated 144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:12.545150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:12.547348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:12.555007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:12.555810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:12.556486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:12.557481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:12.558212 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:12.558909 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:12.986387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:13.006738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:13.010508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:13.012862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-81325e94-3b94-4172-acf5-cae8b41e5dfb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.475600 Aug 10 08:50:13.013962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 450/887] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:12 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:13.029328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4be6cac-69c3-4db5-8f43-98086084bc55"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:13.036489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:13.057136 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:13.061286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:13.062453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:13.063212 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:13.063823 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:13.065085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:14.043821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:14.045201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:14.052394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:14.053168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:14.053826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:14.054885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:14.055541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:14.056164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:14.077702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9778c39e-e2d9-450f-bcb3-b0a14432be90 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051238 Aug 10 08:50:14.079552 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 438/888] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:50:13 2022] POST /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:14.826890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:14.836079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:14.838644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:14.840108 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ae1cb7f1-acaa-403f-a82f-979790496b2c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.800617 Aug 10 08:50:14.840921 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 451/889] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:14 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:15.413317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33df861b-4a2e-4c5c-bfeb-539d13545789"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:15.421153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:15.425045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:15.425617 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:15.426134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:15.426970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:15.427675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:15.428323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:15.863047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:15.864257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:15.871734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:15.875337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:15.883235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:15.884139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:15.884684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:15.885394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:16.083192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:16.092150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:16.094276 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:16.095590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-47451969-3130-48bc-9220-69945bf40786 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.236506 Aug 10 08:50:16.096372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 452/890] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:15 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:16.544499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c985946e-0ce8-43bb-8611-e435f78fa7c2 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134891 Aug 10 08:50:16.557476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 439/891] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:50:15 2022] POST /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 194 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:17.122016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:17.122670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:17.130313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:17.131802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:17.132494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:17.133222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:17.133757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:17.134187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:17.306681 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:17.317498 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:17.319559 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:17.321277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f8f4699e-8a51-48df-ac34-83306343d1df tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1738 microversion: 2.20 time: 0.203197 Aug 10 08:50:17.322484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 453/892] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:17 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:17.744396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-29efe0c2-70aa-41a7-91bd-0d4fe051e553 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Action: 'create', calling method: .version_select at 0x7fdefa2aea60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1917315942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6kzyV224TNvIheS4HCTLH729HqrQYbZi5GAHmIqbYNrVf1Nj2rA58Gx+YE0Bkrt7zNeqV24NCIpDxYbtwv95XhYDS5B6gFu6CNmb/CeAM5qbfdD2JB839BWTzrM+MrQg=="}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:17.760696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-29efe0c2-70aa-41a7-91bd-0d4fe051e553 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Getting quotas for project 2788e89ec8a54cf0812124e6ce142061. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:50:17.765736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-29efe0c2-70aa-41a7-91bd-0d4fe051e553 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Getting quotas for user 1fefe615c29f4a8290c81ec430f8d9ae and project 2788e89ec8a54cf0812124e6ce142061. Resources: {'key_pairs'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:50:17.852148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-29efe0c2-70aa-41a7-91bd-0d4fe051e553 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.322546 Aug 10 08:50:17.852659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 440/893] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:50:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:18.345140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:18.345740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:18.352270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:18.352735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:18.353164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:18.353846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:18.354297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:18.354751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:18.493030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:18.501157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:18.510535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:18.510535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a09ad1f7-3af4-4f47-bb4d-82f1044207e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1720 microversion: 2.20 time: 0.162892 Aug 10 08:50:18.510535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 454/894] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:18 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:19.527946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:19.528674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:19.535617 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:19.536107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:19.536545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:19.537237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:19.538033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:19.538368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:19.719523 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:19.728975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:19.730541 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:19.732547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5b2e6b42-d251-4734-9519-366f109f5f83 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1720 microversion: 2.20 time: 0.209039 Aug 10 08:50:19.733316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 441/895] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:19 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:20.007825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "name": "network-vif-unplugged", "status": "completed", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:20.017597 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:20.018072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:20.018690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:20.030460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] Creating event network-vif-unplugged:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:50:20.036237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-563e9326-d73d-40c6-9825-983cd298f44c req-488ccaca-141c-48ed-ac86-f9f3f727f200 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032177 Aug 10 08:50:20.036882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 455/896] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:20.757253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:20.757788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:20.765396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:20.766268 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:20.766856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:20.768648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:20.768648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:20.768909 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:20.959246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:20.967489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:20.969487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:20.972262 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-473b0b12-2974-437b-ba1e-0d206cbacb69 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1723 microversion: 2.20 time: 0.218225 Aug 10 08:50:20.973533 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 442/897] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:20 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:20.998311 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dad7537b-f6f6-4f44-a7b4-f3fcf0b90761"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:21.000974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:21.008421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:21.010550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:21.010550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:21.010550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:21.010867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:21.011248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:22.158840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1b4eda47-998e-4609-b4ed-dcb3cfe51748 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.165255 Aug 10 08:50:22.163138 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 456/898] 10.222.0.45 () {62 vars in 1364 bytes} [Wed Aug 10 08:50:20 2022] POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments => generated 188 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 08:50:22.297619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:22.298097 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:22.313361 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:22.317033 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:22.317593 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:22.320798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:22.321295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:22.321908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:22.981977 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4be6cac-69c3-4db5-8f43-98086084bc55"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:22.985041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:22.991220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:22.991698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:22.992130 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:22.992807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:22.993261 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:22.993677 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.004393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fa25d6f3-0fde-456f-8963-259e70df6de3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments/dad7537b-f6f6-4f44-a7b4-f3fcf0b90761" status: 202 len: 0 microversion: 2.20 time: 0.711170 Aug 10 08:50:23.013452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 443/899] 10.222.0.45 () {60 vars in 1457 bytes} [Wed Aug 10 08:50:22 2022] DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments/dad7537b-f6f6-4f44-a7b4-f3fcf0b90761 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:50:23.077422 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:23.078785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:23.085892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.086390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.086856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.087553 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.088185 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.088614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.112437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: POST /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments HTTP/1.1 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 74 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:50:23.114339 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {"volumeAttachment": {"volumeId": "a4be6cac-69c3-4db5-8f43-98086084bc55"}} Aug 10 08:50:23.116141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'server_id': '03f2033c-38d9-4a6b-bd49-66e788022276', 'body': {'volumeAttachment': {'volumeId': 'a4be6cac-69c3-4db5-8f43-98086084bc55'}}} Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:50:23.117264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:23.118872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 400 to user: Invalid volume: volume a4be6cac-69c3-4db5-8f43-98086084bc55 is already attached to instances: 03f2033c-38d9-4a6b-bd49-66e788022276 {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:50:23.120624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f20036b5-81ea-45d8-9e1d-a3eacd2b1074 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139073 Aug 10 08:50:23.123137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 457/900] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:50:22 2022] POST /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 08:50:23.145407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124809) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 08:50:23.185956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:23.188811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:23.194219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.194745 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.195348 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.196227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.196686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.197335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.287969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lazy-loading 'services' on Instance uuid 03f2033c-38d9-4a6b-bd49-66e788022276 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:50:23.481742 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-30c087f8-d3e6-4632-b950-480ba5235671 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/action" status: 202 len: 0 microversion: 2.20 time: 0.408250 Aug 10 08:50:23.482229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 444/901] 10.222.0.45 () {62 vars in 1319 bytes} [Wed Aug 10 08:50:23 2022] POST /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 08:50:23.490233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:23.490873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:23.498555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.498555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.499078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.499493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.499948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.500425 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.514416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4817a2b8-fc1a-48a9-aac9-923641e79685 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments/a4be6cac-69c3-4db5-8f43-98086084bc55" status: 202 len: 0 microversion: 2.1 time: 0.332243 Aug 10 08:50:23.515230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 458/902] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:50:23 2022] DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments/a4be6cac-69c3-4db5-8f43-98086084bc55 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:50:23.524535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:23.526994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:23.534069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.534593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.535033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.535729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:23.536184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:23.536636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:23.567508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-57fdafee-595c-408d-a6b2-26c0c4159720 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047737 Aug 10 08:50:23.568075 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 459/903] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:23 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:50:23.636985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:23.645354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:23.647372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:23.648750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f2412f46-60f3-4406-b66d-0db42acaefcf tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1671 microversion: 2.20 time: 0.162197 Aug 10 08:50:23.649306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 445/904] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:23 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:24.580596 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:24.582925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:24.589359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:24.589834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:24.590262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:24.590994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:24.591465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:24.597371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:24.622359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bf0f7d43-4433-4cb7-b0ea-3ef927cbaf50 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Aug 10 08:50:24.623010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 460/905] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:24 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:24.672195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:24.672738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:24.679313 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:24.679802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:24.680246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:24.683352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:24.683352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:24.683352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:24.814619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:24.818187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:24.823445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:24.824983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:24.826144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6d76e0b4-2bed-4fc5-95bd-9ff351b63a3c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1671 microversion: 2.20 time: 0.157943 Aug 10 08:50:24.826738 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 446/906] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:24 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:25.634854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:25.636965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:25.643328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:25.643813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:25.644277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:25.644964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:25.645430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:25.645860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:25.675324 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d0e64c26-b736-498f-aa73-434c280ccde9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 10 08:50:25.675884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 461/907] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:25 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:25.849581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:25.850164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:25.856870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:25.857352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:25.857787 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:25.858490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:25.859573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:25.859995 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:26.073061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:26.081512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:26.083047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:26.084216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d3e4a1ac-c990-4d2e-a020-076773e0f73d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.238888 Aug 10 08:50:26.084779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 447/908] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:25 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:26.687144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:26.689509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:26.696039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:26.696526 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:26.696965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:26.697692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:26.698146 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:26.698592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:26.713224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:26.729884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-975d8e9e-2adb-4444-8c32-0b716683b2ac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Aug 10 08:50:26.730441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 462/909] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:26 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:27.108301 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:27.108983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:27.115633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:27.116112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:27.118480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:27.118480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:27.118480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:27.118480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:27.635278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:27.643862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:27.645359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:27.646556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f578119e-6089-493c-9e61-39b79debf71b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.542446 Aug 10 08:50:27.647374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 448/910] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:27 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:27.742655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:27.746032 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:27.767418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:27.768289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:27.768901 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:27.769806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:27.770422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:27.771015 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:27.805682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e10169f0-1cce-4550-8b73-240eb108e077 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068017 Aug 10 08:50:27.806249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 463/911] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:27 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:28.672549 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:28.673247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:28.675111 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=4 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:28.680269 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:28.680869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:28.681317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:28.682014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:28.682532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:28.682931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:28.817315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:28.819390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:28.826297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:28.826799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:28.827229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:28.827948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:28.828392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:28.828807 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:28.841518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:28.850071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:28.851603 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:28.852790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d36f55fe-9186-43aa-a390-e254b5d8ff4a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.184935 Aug 10 08:50:28.853345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 449/912] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:28 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:28.858640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6720ffd5-71fe-41ff-9e8c-a9aa39edaa1c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Aug 10 08:50:28.860048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 464/913] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:28 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:50:29.871775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:29.874170 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:29.876833 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:29.877441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:29.881205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:29.881687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:29.882122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:29.882872 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:29.883323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:29.883759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:29.883889 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:29.884365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:29.884798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:29.885484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:29.885939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:29.886363 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:29.915885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-35a4d2c2-ae85-4764-90f1-1b43eafbec0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048091 Aug 10 08:50:29.920393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 450/914] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:29 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:30.024051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:30.041585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:30.043100 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:30.044278 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6ec97439-35b3-42d2-b5e0-cea81596244c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.172308 Aug 10 08:50:30.045207 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 465/915] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:29 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:30.928919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:30.932034 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:30.938794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:30.939278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:30.939917 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:30.940629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:30.941082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:30.941662 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:30.970834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7b942b24-4a97-44c0-bd2b-298a8aa4ce5b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 10 08:50:30.971386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 451/916] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:30 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:31.066417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:31.067095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:31.073476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:31.073972 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:31.074413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:31.075140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:31.075600 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:31.076033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:31.221092 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:31.229873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:31.231418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:31.232598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-84764444-7ed8-460d-8d2c-8856a9eb7bf0 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.170171 Aug 10 08:50:31.247922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 466/917] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:31 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:31.983607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:31.986236 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:31.992633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:31.993112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:31.993555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:31.994241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:31.994790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:31.995303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:32.028752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-42167284-470b-4506-9ca5-7addbcdf2eef tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Aug 10 08:50:32.029904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 452/918] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:31 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:32.255738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:32.256415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:32.262755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:32.263515 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:32.263951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:32.264710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:32.265779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:32.266240 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:32.424980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:32.435691 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:32.437980 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:32.439036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f6f981cd-9792-4cca-9b36-8a5d3f49ad89 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.187483 Aug 10 08:50:32.439592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 467/919] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:32 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:33.041382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:33.043574 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:33.050240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:33.050693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:33.051128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:33.051807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:33.052257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:33.052678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:33.082486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b0177899-2998-4665-bdb9-14b1b9516ac7 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Aug 10 08:50:33.083792 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 453/920] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:33 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:33.462168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:33.462802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:33.469113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:33.469591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:33.470020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:33.470728 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:33.471178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:33.471598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:33.612107 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:33.620653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:33.622413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:33.623834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bfdcf027-c4af-46a3-89d7-dcddc226114a tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.165484 Aug 10 08:50:33.625872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 468/921] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:33 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:34.094441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:34.096547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:34.103393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:34.103904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:34.104341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:34.105037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:34.105493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:34.105922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:34.137026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2d40adbd-88bc-4e03-b185-fd89f92b6049 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Aug 10 08:50:34.137605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 454/922] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:34 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:34.648587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:34.649200 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:34.655803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:34.656815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:34.657246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:34.657943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:34.658612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:34.658837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:34.804679 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:34.812678 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:34.814168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:34.815342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-970355e6-0e28-4de4-870c-a3a9a57ab4b6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.170998 Aug 10 08:50:34.815903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 469/923] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:34 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:35.150658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:35.152603 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:35.159886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:35.160416 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:35.160842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:35.161542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:35.162002 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:35.162414 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:35.192540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3286bf46-659c-4d37-8977-7dc83c07805f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Aug 10 08:50:35.193109 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 455/924] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:35 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:35.840810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:35.842665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:35.850435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:35.851260 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:35.852254 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:35.853176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:35.853822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:35.854446 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:35.995329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:36.003870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:36.005361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:36.006539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ec627d28-8344-4f85-9511-cfb03a02b400 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.170432 Aug 10 08:50:36.007096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 470/925] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:35 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:36.204763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:36.206948 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:36.213365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:36.213849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:36.214295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:36.215016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:36.215476 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:36.215904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:36.251590 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c77e65e3-304b-42f1-a60b-304af5d7a292 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Aug 10 08:50:36.252299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 456/926] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:36 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:37.028478 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:37.029091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:37.035439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:37.035920 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:37.036358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:37.037047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:37.037502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:37.037925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:37.163988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:37.172269 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:37.173780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:37.174967 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-710e0ef0-4980-45c8-8e05-1ecd18c252e4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.150360 Aug 10 08:50:37.175532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 471/927] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:37 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:37.263647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:37.265834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:37.272434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:37.272915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:37.273436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:37.274038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:37.274522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:37.274954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:37.303846 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5ee13639-7b26-40d5-a868-3b649aca5264 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Aug 10 08:50:37.304402 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 457/928] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:37 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:38.198028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:38.198610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:38.205037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:38.205522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:38.205960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:38.206683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:38.207144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:38.207572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:38.316514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:38.318681 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:38.320960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:38.325528 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:38.326009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:38.326445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:38.327160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:38.327614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:38.328078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:38.343141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:38.351579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:38.353093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:38.354334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-824dd6c0-4524-4175-9f70-9d23f314f72d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.160203 Aug 10 08:50:38.354937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 472/929] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:38 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:38.357820 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6443184e-c240-4bfa-84ca-c3b2e9cf63f3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 10 08:50:38.358380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 458/930] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:38 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:50:39.370120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:39.372235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:39.378747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:39.379355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:39.380484 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:39.380979 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:39.381416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:39.382114 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:39.382607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:39.383034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:39.386018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:39.386525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:39.386970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:39.387658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:39.388120 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:39.388544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:39.413331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ab1f2357-05e9-478e-84fb-8c5ee7fbdab5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Aug 10 08:50:39.413902 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 473/931] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:39 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:39.523598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:39.532099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:39.533584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:39.534799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-eca1e2a3-499f-4cdc-afcb-1e08e5e2c926 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.161765 Aug 10 08:50:39.537914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 459/932] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:39 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:40.425786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:40.427976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:40.434375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:40.434891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:40.435323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:40.436004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:40.436457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:40.436879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:40.465308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-102e02cb-5663-43f6-86db-c6dfec826d84 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Aug 10 08:50:40.465858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 474/933] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:40 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:40.558012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:40.558709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:40.565562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:40.566071 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:40.566531 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:40.567245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:40.567696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:40.568117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:40.696585 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:40.705212 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:40.708642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:40.708642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ff0eeee6-9ab3-4345-861e-e64048c6cd57 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.153828 Aug 10 08:50:40.708642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 460/934] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:40 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:41.478214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:41.480384 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:41.482720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=54 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:41.487893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:41.488377 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:41.488812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:41.489493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:41.489947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:41.490368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:41.521126 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f71be0ad-d3db-4e9b-be74-e721b68a31ad tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 Aug 10 08:50:41.521953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 475/935] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:41 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:41.731106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:41.731677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:41.738101 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:41.738758 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:41.739198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:41.739885 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:41.740338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:41.740763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:41.869833 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:41.877944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:41.879475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:41.880630 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-970d3cea-d285-412c-8331-b75207b8d297 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.153921 Aug 10 08:50:41.881184 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 461/936] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:41 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:42.534262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:42.536456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:42.542899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:42.543382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:42.543815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:42.544496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:42.544978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:42.545398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:42.575213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-84cfd991-9722-4d64-bc6c-f860ceacb8c6 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Aug 10 08:50:42.575775 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 476/937] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:42 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:42.903797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:42.904436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:42.919450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:42.919450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:42.919450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:42.919450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:42.919817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:42.919817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:43.073802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:43.081619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:43.083151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:43.084286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0b351b61-90dc-4837-8d30-ed3307e0c998 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.184448 Aug 10 08:50:43.084835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 462/938] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:42 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:43.587606 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:43.589791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:43.596169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:43.596651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:43.597087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:43.597772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:43.598228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:43.598719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:43.628163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aa030a37-29a4-4b8b-917b-2bd9e02ea572 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044304 Aug 10 08:50:43.629093 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 477/939] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:43 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:44.107579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:44.108212 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:44.115233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:44.115652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:44.116088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:44.116771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:44.117227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:44.117649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:44.135529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=100 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:44.250265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:44.258789 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:44.260293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:44.261446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4991f72c-f4c7-4e39-b06f-d47319701f03 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.157807 Aug 10 08:50:44.262014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 463/940] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:44 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:44.640910 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:44.643544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:44.650012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:44.650544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:44.650976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:44.651648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:44.652094 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:44.652509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:44.681091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8eb204ea-e9f7-4c87-be6e-ad324b8e09bd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 10 08:50:44.681633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 478/941] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:44 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:45.283932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:45.284869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:45.290932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:45.291412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:45.291849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:45.292532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:45.292988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:45.293412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:45.420353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:45.428967 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:45.430479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:45.431658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2076e067-d7f4-4e35-97b1-88260a4459f9 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.151616 Aug 10 08:50:45.432215 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 464/942] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:45 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:45.694127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:45.696308 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:45.702557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:45.703036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:45.703464 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:45.704247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:45.704721 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:45.705139 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:45.708633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=100 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:45.733960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3b83a517-1e30-4af4-a0a2-c887b2a362d5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044632 Aug 10 08:50:45.734536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 479/943] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:45 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:46.105935 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1575571158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1917315942", "security_groups": [{"name": "tempest-secgroup-smoke-1245665835"}], "networks": [{"uuid": "b2a33bd3-7417-4e69-9670-c17eedfdee27"}], "block_device_mapping_v2": [{"uuid": "2d644298-d180-4dd0-b3c6-39133c7e7c45", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:46.241417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] validate_networks() for [('b2a33bd3-7417-4e69-9670-c17eedfdee27', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:50:46.455863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:46.456634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:46.462577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.463058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.463496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.464179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.464633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.465115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.595943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:46.603895 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:46.605394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:46.606624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e943f3da-c303-4473-ac3d-0d9d21f92bdc tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.155553 Aug 10 08:50:46.607186 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 480/944] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:46 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:46.729707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:50:46.730316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:50:46.731018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:50:46.732258 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:50:46.732759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:50:46.743384 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.744021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.744555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.745350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.745875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.746679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.747399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:46.749787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:46.766740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.768108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Getting quotas for project 2788e89ec8a54cf0812124e6ce142061. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:50:46.769246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.772174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.772579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Getting quotas for user 1fefe615c29f4a8290c81ec430f8d9ae and project 2788e89ec8a54cf0812124e6ce142061. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:50:46.774449 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:46.776318 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:46.777222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:46.824873 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0f72c145-dd0d-4ec5-b9cf-7a5668c7f4a9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082087 Aug 10 08:50:46.826016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 481/945] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:46 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:46.849638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:50:46.852580 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d644298-d180-4dd0-b3c6-39133c7e7c45',volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:50:47.286802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-81e8e1fd-99a1-47d5-a4d1-7ae6bf7873be tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.185253 Aug 10 08:50:47.287455 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 465/946] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:50:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:50:47.298175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b946267a-6de7-410d-97a3-4130fdb052aa tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:47.299422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b946267a-6de7-410d-97a3-4130fdb052aa tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:47.355040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b946267a-6de7-410d-97a3-4130fdb052aa tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:47.364196 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b946267a-6de7-410d-97a3-4130fdb052aa tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1089 microversion: 2.1 time: 0.069638 Aug 10 08:50:47.364917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 482/947] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:47 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:47.476782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:47.479053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:47.485451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.486551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.486982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.487660 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.488984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.491454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.519814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c4a6449e-6f8e-4719-a7c1-03f5bffa53ec tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047012 Aug 10 08:50:47.520412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 466/948] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:47 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:47.531369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:47.531862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:47.538275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.538894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.539228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.539913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.540368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.540799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.569510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9b4155b4-59fe-408c-b3cb-ad9dd799c0f5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789" status: 200 len: 194 microversion: 2.1 time: 0.042154 Aug 10 08:50:47.570094 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 483/949] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 08:50:47 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:47.630076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:47.630826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:47.637031 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.638677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.638677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.638874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.639291 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.639719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.777849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:47.786479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:47.787974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:47.789117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5cd82400-602c-447c-a790-e0a72cbf5bdb tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.163659 Aug 10 08:50:47.789676 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 467/950] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:47 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:47.837490 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:47.840409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:47.848455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.848939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.849373 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.850067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:47.850558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:47.850982 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:47.880594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4419812f-59c3-4a33-8416-cf5ff26c0422 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Aug 10 08:50:47.881575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 484/951] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:47 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:48.064356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "name": "network-vif-plugged", "status": "completed", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:48.073514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:48.073989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:48.074453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:48.085208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] Creating event network-vif-plugged:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:50:48.090336 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-ab68eb3d-44e6-42cd-bcf8-eb784370c30a req-85208a0d-6423-453b-b8d0-ad6842432755 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029593 Aug 10 08:50:48.090914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 468/952] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:48.385591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-382b631f-c18f-4353-b91e-0a17c7db2c38 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:48.386207 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-382b631f-c18f-4353-b91e-0a17c7db2c38 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:48.438732 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-382b631f-c18f-4353-b91e-0a17c7db2c38 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:48.445409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-382b631f-c18f-4353-b91e-0a17c7db2c38 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1089 microversion: 2.1 time: 0.064057 Aug 10 08:50:48.446013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 485/953] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:48 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1089 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:48.812642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:48.813344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:48.819924 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:48.820400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:48.820829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:48.821529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:48.821984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:48.822401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:48.893630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:48.896756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:48.903802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:48.904289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:48.904730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:48.905433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:48.905890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:48.906320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:48.935982 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-14d0737e-5339-497e-abc0-e5bd7098fc12 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047019 Aug 10 08:50:48.936551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 486/954] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:50:48 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 08:50:48.956724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:48.965038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:48.966637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:48.967871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c9d6bafe-d283-4c2d-8efe-e5adbdef7a8c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.160027 Aug 10 08:50:48.968502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 469/955] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:48 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:49.004000 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:49.004634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:49.010929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.011535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.012063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.012830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.013357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.013866 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.039884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:50:49.466544 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:49.467146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:49.473081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.473558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.473986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.474696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.475146 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.475562 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.542130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:49.550319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-23113e9e-3f4c-491d-9227-7a76fef1e2e0 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1139 microversion: 2.1 time: 0.087625 Aug 10 08:50:49.550926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 470/956] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:49 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:49.661516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6be13fb9-42e9-49a2-b83c-233f1884bc39 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 204 len: 0 microversion: 2.1 time: 0.661525 Aug 10 08:50:49.662107 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 487/957] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:50:48 2022] DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:50:49.670011 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:49.671602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:49.677095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.677567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.677998 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.678705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:49.679155 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:49.679574 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:49.806128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:49.813729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fc784c48-7cd5-48ca-9c2e-f2b237b64452 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1680 microversion: 2.1 time: 0.147473 Aug 10 08:50:49.814339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 471/958] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:49 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:49.991347 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:49.992077 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:49.999888 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.000378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.000818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.001520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.001975 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.002400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.131323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:50.139035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:50.140521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:50.141666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-67c3bbac-2eb8-4797-a5fd-a1adec079512 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.154822 Aug 10 08:50:50.142747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 488/959] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:49 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:50.270882 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04418073-29fe-41cf-ae15-bd2a20312faf"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:50.273558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:50.279576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.280050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.280487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.281168 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.281652 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.282073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.571236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:50.571782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:50.577856 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.578351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.578826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.579659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.580610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.581040 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.638984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:50.647159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8cd214f4-7bba-4cb9-aca1-386bd76587b5 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1131 microversion: 2.1 time: 0.079888 Aug 10 08:50:50.647729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 489/960] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:50 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1131 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:50.834753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:50.835306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:50.841152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.841628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.842058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.842759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:50.843209 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:50.843627 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:50.973654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:50.981222 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-15be78a2-da70-4ba3-91e1-da706e6ab5db tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1680 microversion: 2.1 time: 0.150521 Aug 10 08:50:50.981787 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 490/961] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:50 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:51.164481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:51.165074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:51.171403 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:51.171899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:51.172340 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:51.173033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:51.174112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:51.174563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:51.309951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:51.317894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:51.319444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:51.320604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-eaef5d19-3318-4da8-a7b1-2da0cd25cfb7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.159973 Aug 10 08:50:51.321167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 491/962] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:51 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 08:50:51.675415 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:51.676061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:51.682142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:51.682663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:51.683188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:51.683765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:51.684216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:51.684636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:51.747628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:51.755851 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8e8e1612-5419-44d4-8d81-4f82a20a5b57 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1131 microversion: 2.1 time: 0.084257 Aug 10 08:50:51.756369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 492/963] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:51 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1131 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:52.003899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:52.004509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:52.010488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.012135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.012135 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.012299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.012647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.013069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.142876 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:52.150619 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d6b6822f-ecbb-41d5-9fc6-7cca89fdcf11 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1680 microversion: 2.1 time: 0.151052 Aug 10 08:50:52.151185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 493/964] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:51 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:52.343399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:52.344142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:52.352312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.352804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.353246 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.353941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.354394 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.354843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.497117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:52.505914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:52.507442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:52.508621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ba132e78-5ed5-40e8-bd0a-4352dc22c121 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1729 microversion: 2.20 time: 0.169142 Aug 10 08:50:52.509183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 494/965] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:52 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:52.777377 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:52.777994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:52.784435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.784926 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.785358 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.786053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:52.786531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:52.786984 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:52.853497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:52.861535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f0cf77ab-37f6-47f3-a496-d3452e4463ed tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1131 microversion: 2.1 time: 0.087564 Aug 10 08:50:52.862105 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 495/966] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:52 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1131 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:50:52.872234 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1dce7d7c-0d69-4146-82ca-e7fff0953aff tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "POST /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.606148 Aug 10 08:50:52.873193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 472/967] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:50:50 2022] POST /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 194 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:53.171997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:53.172838 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:53.179681 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.180245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.180694 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.181396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.181856 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.182510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.185691 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f2033c-38d9-4a6b-bd49-66e788022276", "name": "network-vif-deleted", "tag": "2d2c58b3-531d-478a-ae7a-5e94de0cbd39"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:53.186773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:53.203322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.203322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.203322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.207619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] Creating event network-vif-deleted:2d2c58b3-531d-478a-ae7a-5e94de0cbd39 for instance 03f2033c-38d9-4a6b-bd49-66e788022276 on hv-cinder-78102 Aug 10 08:50:53.212415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-e8a0347a-d3a0-40bd-8c93-38d928198365 req-85dd8669-67d1-435d-8343-90bc8040c9f0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Aug 10 08:50:53.213183 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 473/968] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:50:53.247272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:53.256587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cfc95318-6cd5-4a5a-a651-fc29ea179b0c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 200 len: 1612 microversion: 2.1 time: 0.088311 Aug 10 08:50:53.257414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 496/969] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:53 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:53.534086 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:53.536598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:53.543491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.544005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.544659 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.545510 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.545987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.546457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.726195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:53.735307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:53.737345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:53.738135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-79f467f9-f695-406f-834e-bf85963f973d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1716 microversion: 2.20 time: 0.209660 Aug 10 08:50:53.744338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 474/970] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:50:53 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1716 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:50:53.883706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:53.885592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:53.890996 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.891556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.892495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.893208 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:53.893660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:53.894087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:53.987930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:53.996513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5dcff589-3eef-4ae0-a67f-70c089d51b07 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1205 microversion: 2.1 time: 0.117012 Aug 10 08:50:54.007068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 497/971] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:53 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1205 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:54.280019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:54.280634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:54.287444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:54.287944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:54.288383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:54.289285 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:54.289908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:54.290573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:54.305260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 HTTP/1.1 Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:50:54.307290 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:50:54.309453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '03f2033c-38d9-4a6b-bd49-66e788022276'} Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:50:54.310280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:50:54.312006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:50:54.313400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:50:54.313400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f6f7e425-1ec5-459d-aa85-b2c16379c508 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 404 len: 111 microversion: 2.1 time: 0.032847 Aug 10 08:50:54.313400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 475/972] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:54 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:50:54.321027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-047eeb1e-7e14-4f3d-8447-f66853a6f01f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '.version_select at 0x7fdef59848b0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:54.422644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-047eeb1e-7e14-4f3d-8447-f66853a6f01f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-669523742" status: 202 len: 0 microversion: 2.1 time: 0.105450 Aug 10 08:50:54.424631 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 498/973] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 08:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-669523742 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:50:55.018909 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:55.019627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:55.026245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:55.026829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:55.027337 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:55.028099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:55.028796 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:55.029234 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:55.241933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:55.242293 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6f828d0d-a226-4e02-9af8-b5c7d635eb81 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: .version_select at 0x7fdef57e30d0>, body: {"keypair": {"name": "tempest-keypair-1829588845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcfsVJLA2g5whzzruzvDmPk5GhKPJY2iOg5vu9C03oiZgFAXG1mv3xXT+BAOpyaYQzP/4c3Eb0tkDhVuxUbxbHst8rADC+LQ6bw6pAhhn9E4zhXZg4va/lHFm7Gt3rZbA=="}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:55.250225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8105b82a-0a88-46e7-933e-71d2912ecd8b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.235483 Aug 10 08:50:55.251461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 476/974] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:55 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:55.260009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-6f828d0d-a226-4e02-9af8-b5c7d635eb81 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:50:55.263899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-6f828d0d-a226-4e02-9af8-b5c7d635eb81 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'key_pairs'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:50:55.336882 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6f828d0d-a226-4e02-9af8-b5c7d635eb81 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100731 Aug 10 08:50:55.337500 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 499/975] 10.222.0.45 () {60 vars in 1159 bytes} [Wed Aug 10 08:50:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:55.719986 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:55.729712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:55.730196 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:55.730687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:55.741812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] Creating event network-changed:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:50:55.747078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-7628963d-e6b7-4f41-9443-387e66e88189 req-334af2df-4e0f-46d0-91b5-4742153bdf94 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031450 Aug 10 08:50:55.747683 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 477/976] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:50:56.271861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:56.272472 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:56.278344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:56.278853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:56.279285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:56.279978 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:56.280426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:56.280846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:56.416124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:56.424295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cc832388-2b20-4367-928e-01cebd64b03a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.157134 Aug 10 08:50:56.424877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 500/977] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:56 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:57.446175 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:57.446904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:57.449332 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:57.449983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=6 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:50:57.455181 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:57.455663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:57.456094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:57.456818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:57.457274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:57.457702 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:57.666253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:57.674398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-22d9a7e1-b5ba-430e-a715-8759b5458e52 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.232539 Aug 10 08:50:57.675008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 478/978] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:57 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:57.811805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-479041950", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec743362-15f5-4239-ba7d-fe3ce8ba53bc"}], "security_groups": [{"name": "tempest-securitygroup--987429720"}], "key_name": "tempest-keypair-1829588845", "user_data": "}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:50:57.914943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] validate_networks() for [('ec743362-15f5-4239-ba7d-fe3ce8ba53bc', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:50:58.274900 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:50:58.275322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:50:58.275803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:50:58.276270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:50:58.276680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:50:58.290541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:58.290541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:58.290541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:58.290541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:58.290913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:58.290913 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:58.305962 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:50:58.309956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Getting quotas for user 4542138b7aa5446b8544dc766cbcb372 and project 934ce9d029694762938d6a2264fad07d. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:50:58.321740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:50:58.324057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:50:58.469068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2cabd865-f6fc-4325-ac34-04e14b6d2519 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661730 Aug 10 08:50:58.470690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 501/979] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:50:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:50:58.481256 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2691e275-b6a9-45f2-b74b-4ba84653dadb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:58.481933 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2691e275-b6a9-45f2-b74b-4ba84653dadb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:58.539840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2691e275-b6a9-45f2-b74b-4ba84653dadb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:58.546794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2691e275-b6a9-45f2-b74b-4ba84653dadb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1241 microversion: 2.1 time: 0.069278 Aug 10 08:50:58.547555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 479/980] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:58 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:58.696027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:58.696633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:58.703374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:58.703848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:58.704906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:58.705589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:58.706037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:58.706457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:58.836615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:58.844788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ef9f9f67-a5d2-4eb4-a53d-bb3ec630c57e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.152938 Aug 10 08:50:58.845362 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 502/981] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:58 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:59.568489 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:59.569098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:59.576278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:59.576764 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:59.577204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:59.577944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:59.578412 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:59.578863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:59.638711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:50:59.646581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-45da270d-6fdb-4ae2-8487-423da7a66dca tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1245 microversion: 2.1 time: 0.082334 Aug 10 08:50:59.647148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 480/982] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:59 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:50:59.865716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:50:59.866332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:50:59.872854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:59.873342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:59.873779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:50:59.874489 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:50:59.874956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:50:59.875432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:00.006740 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:00.014174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-566b0f85-7a44-4aed-9054-ad234b8af305 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.152948 Aug 10 08:51:00.014782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 503/983] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:50:59 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:00.667426 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:00.668053 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:00.674322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:00.678720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:00.678720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:00.678720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:00.678720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:00.679139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:00.742036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:00.750081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fc6465cf-750e-4236-ac23-c2035aa35898 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1237 microversion: 2.1 time: 0.086538 Aug 10 08:51:00.750956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 481/984] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:00 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:01.035304 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:01.035910 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:01.042447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.042961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.043395 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.044081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.044531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.044951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.175885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:01.183214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-50038b31-35dc-42c4-be89-4aaffd0afd94 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.151719 Aug 10 08:51:01.183780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 504/985] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:01 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:01.542102 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:01.544556 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:01.551514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.552286 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.553011 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.554117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.554780 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.555216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.589769 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e9ed955f-916a-437d-b526-e1cc8ebcde9b tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051653 Aug 10 08:51:01.590355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 482/986] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:51:01 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:01.733247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:01.733864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:01.740729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.741280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.742033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.742769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.743225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.743655 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.773576 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:01.774393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:01.783123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-af18de6c-b694-4827-97d9-a124d6925459 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789" status: 200 len: 194 microversion: 2.1 time: 0.054278 Aug 10 08:51:01.783649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.784163 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.784609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.785308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.785763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.786193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.789117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 505/987] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 08:51:01 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:01.791083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:01.794452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:01.794966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:01.796811 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:01.801898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.802380 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.802999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.803793 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:01.804748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:01.805189 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:01.874445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:01.882720 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f91caba6-9c5d-41c8-bbca-1274e42afcac tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1299 microversion: 2.1 time: 0.113793 Aug 10 08:51:01.883289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 483/988] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:01 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:01.890906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lazy-loading 'services' on Instance uuid 77f6cfec-568b-48f0-8921-cf60a016e438 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:51:02.117633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f6268627-1393-49b7-9756-c280d216c642 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789" status: 202 len: 0 microversion: 2.1 time: 0.327216 Aug 10 08:51:02.118332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 506/989] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:51:01 2022] DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/33df861b-4a2e-4c5c-bfeb-539d13545789 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:51:02.204040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:02.204633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:02.213273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:02.213757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:02.214194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:02.215003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:02.215458 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:02.215886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:02.416350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:02.423837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4d720482-7706-4f12-8c68-6b36f23d955a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1273 microversion: 2.1 time: 0.223673 Aug 10 08:51:02.424397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 484/990] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:02 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:02.904335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:02.905024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:02.911593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:02.912067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:02.912497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:02.913173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:02.913623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:02.914042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:03.039320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:03.046648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aa8cb030-87eb-40ca-a9fc-92347ee27ff9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.146543 Aug 10 08:51:03.047147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 507/991] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:02 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:03.444607 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:03.445213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:03.452262 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:03.452793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:03.453295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:03.454004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:03.454483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:03.454912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:03.596235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:03.604154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-11b937da-dd3d-43e9-a213-16acc034a224 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.163518 Aug 10 08:51:03.604713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 485/992] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:03 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:04.067668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:04.068288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:04.075068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:04.075570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:04.076247 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:04.076976 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:04.077850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:04.078291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:04.215880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:04.223329 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c0805da2-8223-430c-bb0c-f2e4ca6b00f1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.159636 Aug 10 08:51:04.223899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 508/993] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:04 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:04.302103 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c6fd05-b0f9-4f2c-a0c0-e952c3de2629", "tag": "1c4397ca-a76f-4bf1-b313-636c28f45854"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:04.315880 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:04.326046 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:04.327162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:04.349672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] Creating event network-changed:1c4397ca-a76f-4bf1-b313-636c28f45854 for instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 on hv-cinder-78102 Aug 10 08:51:04.360303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-15bd855a-4349-4ea5-baca-cf352a20a4de req-46c25472-7e91-426b-ba3d-f0cda4e3c16b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068859 Aug 10 08:51:04.361508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 486/994] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:04.625693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:04.626309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:04.632763 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:04.633333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:04.633769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:04.634455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:04.634935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:04.635351 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:04.765603 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:04.774071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ca7e2684-6421-4159-a234-2c87c5c937d1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.152249 Aug 10 08:51:04.774677 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 509/995] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:04 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:05.245261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:05.245980 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:05.252057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.252558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.253655 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.254338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.254822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.255247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.385081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:05.392452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2817ed8a-1e43-4791-beb7-82e07c2e695c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.151898 Aug 10 08:51:05.393016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 487/996] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:05 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:05.498620 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:05.499121 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:05.506115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.506632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.507062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.507755 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.508202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.508659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.537210 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-75138e0e-2cda-4e3f-94e3-a4afa0085eeb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/04418073-29fe-41cf-ae15-bd2a20312faf" status: 200 len: 194 microversion: 2.1 time: 0.042561 Aug 10 08:51:05.537783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 510/997] 10.222.0.45 () {58 vars in 1413 bytes} [Wed Aug 10 08:51:05 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/04418073-29fe-41cf-ae15-bd2a20312faf => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:05.548116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:05.548601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:05.555056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.555529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.555956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.556628 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.557076 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.557493 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.636327 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lazy-loading 'services' on Instance uuid 77f6cfec-568b-48f0-8921-cf60a016e438 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:51:05.795359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:05.795964 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:05.802387 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.806680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.806680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.806680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:05.806680 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:05.807058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:05.865714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9abfdf76-2306-4774-a999-666bf713f29a tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/04418073-29fe-41cf-ae15-bd2a20312faf" status: 202 len: 0 microversion: 2.1 time: 0.321274 Aug 10 08:51:05.866538 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 488/998] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:51:05 2022] DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments/04418073-29fe-41cf-ae15-bd2a20312faf => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:51:05.938096 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:05.945627 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a65db5fa-b89e-49d6-8b7a-2f742e59371f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.154049 Aug 10 08:51:05.946196 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 511/999] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:05 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:06.414109 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:06.414822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:06.421003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:06.421488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:06.421920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:06.422640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:06.423096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:06.423525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:06.551451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:06.559421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1fd5a920-9c98-4639-b8e3-393bc88df823 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.149900 Aug 10 08:51:06.559993 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 489/1000] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:06 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:06.966753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:06.967370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:06.974671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:06.975164 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:06.975602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:06.976298 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:06.976765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:06.977195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:07.105221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:07.112651 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fa3c749c-27a3-4be7-aaf4-0b35aed540ee tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.150070 Aug 10 08:51:07.113201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 512/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:06 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:07.580190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:07.580818 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:07.587490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:07.587970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:07.588401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:07.589083 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:07.589532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:07.589953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:07.722518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:07.730044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-466bdc92-db5f-4446-a203-6bf379ba3948 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.153695 Aug 10 08:51:07.730669 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 490/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:07 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:08.132991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:08.133646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:08.140204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:08.140692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:08.141136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:08.141857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:08.142325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:08.142779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:08.274822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:08.283398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a528a034-875f-4fb2-9e19-b6facfc385cf tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.154263 Aug 10 08:51:08.284581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 513/1003] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:08 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:08.752321 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:08.753795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:08.755829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:08.761126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:08.761645 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:08.762090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:08.762819 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:08.763281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:08.763822 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:08.891016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:08.899369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4834ceef-2057-4d93-956e-fa0991c17f47 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.151512 Aug 10 08:51:08.899934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 491/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:08 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:09.150665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.152853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.154857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:09.155579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=14 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:09.160560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.161039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.161476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.162155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.162636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.165169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.191231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:09.193405 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-825811b1-ece2-471c-a0dd-2bf0888841c5 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046837 Aug 10 08:51:09.193974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 514/1005] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:51:09 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:51:09.305400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.306107 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.307613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.309831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.312640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.313130 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.313569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.314716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.315906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.316341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.317723 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.318206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.318671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.319356 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.319810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.320228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.349459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f14aecb5-2afe-43f4-a8d6-fd32b33ffb0d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045644 Aug 10 08:51:09.350307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 515/1006] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:51:09 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 08:51:09.411396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.411823 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.418187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.418706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.419143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.419832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.420286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.420710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.445878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:51:09.450131 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:09.457858 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-74a50ec2-e147-4d85-ab84-e273c06bc575 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.156677 Aug 10 08:51:09.458436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 492/1007] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:09 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:09.768720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-986489d1-a9fe-439b-bac9-3378ae105c8d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 204 len: 0 microversion: 2.1 time: 0.361482 Aug 10 08:51:09.769317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 516/1008] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:51:09 2022] DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:51:09.777560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.778164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.780501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:09.785299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.788462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.788462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.788462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.788462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.788808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.920245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:09.920574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:09.921293 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:09.925013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-838ad40d-76af-4d10-97be-560d5e972159 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1672 microversion: 2.1 time: 0.150733 Aug 10 08:51:09.925806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 493/1009] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:09 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:09.928412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.928897 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.929355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:09.930080 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:09.930574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:09.930994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:10.065297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:10.072751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-eadf3f7c-9320-49b8-92f3-c907c2954b64 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.156500 Aug 10 08:51:10.073317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 517/1010] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:09 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:10.320766 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c6fd05-b0f9-4f2c-a0c0-e952c3de2629", "name": "network-vif-plugged", "status": "completed", "tag": "1c4397ca-a76f-4bf1-b313-636c28f45854"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:10.330134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:10.330641 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:10.331629 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:10.342742 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] Creating event network-vif-plugged:1c4397ca-a76f-4bf1-b313-636c28f45854 for instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 on hv-cinder-78102 Aug 10 08:51:10.347694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-50d70340-cd90-4bab-8ed4-957b80d0288a req-18dc2347-0602-47e5-9b4d-0f3fa47702e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 Aug 10 08:51:10.348331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 494/1011] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:10.490810 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:10.491418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:10.497688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:10.498179 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:10.498653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:10.499337 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:10.499794 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:10.500221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:10.629028 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:10.637551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c3b708ab-02b3-45b4-bc76-1e0ca7d3b0ec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.151034 Aug 10 08:51:10.638129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 518/1012] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:10 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:10.947781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:10.948508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:10.954965 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:10.955457 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:10.955895 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:10.956728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:10.957192 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:10.957619 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:11.087600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:11.093010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:11.093629 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:11.095712 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6f22ab68-78dd-4a4c-b8bc-20298a2df04d tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1672 microversion: 2.1 time: 0.152800 Aug 10 08:51:11.106503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 495/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:10 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:11.106672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:11.106672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:11.106672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:11.106672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:11.107010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:11.107010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:11.234182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:11.242429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8fb298bd-b793-4744-9430-156bf868957f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.153119 Aug 10 08:51:11.243169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 519/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:11 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:11.658515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:11.659064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:11.664966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:11.665447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:11.665884 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:11.666600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:11.667056 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:11.667481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:11.800187 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:11.807832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3572418c-a402-49fe-b9e2-a0c259497e58 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.153295 Aug 10 08:51:11.808394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 496/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:11 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:12.117450 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:12.118065 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:12.124258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.127336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.127336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.127336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.127336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.127736 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.260762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:12.262862 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:12.264030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:12.268525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-483d7f5d-0090-42a5-a5c4-7ab6c49d7383 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1672 microversion: 2.1 time: 0.154900 Aug 10 08:51:12.269147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 520/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:12 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:12.272392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.272875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.273478 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.274305 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.274861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.275287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.369827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "name": "network-vif-plugged", "status": "completed", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:12.379682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.380298 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.380831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.392270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] Creating event network-vif-plugged:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:51:12.397577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-5b902fa9-2788-4bf5-ad63-3b003c132041 req-3752c967-1205-43f0-9e6d-3b0e961c2685 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 Aug 10 08:51:12.398315 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 521/1017] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:51:12.414863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:12.422445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c6fc4318-1855-41d8-9fca-44c5797dfd0d tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.163366 Aug 10 08:51:12.423037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 497/1018] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:12 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:12.829046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:12.829736 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:12.836626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.837112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.837577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.838267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:12.838757 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:12.839184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:12.969590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:12.977872 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-693ad04c-968b-40c4-92ae-ce9c7004db86 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.153006 Aug 10 08:51:12.978439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 522/1019] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:12 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:13.289740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:13.290343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:13.296709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:13.307338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:13.307338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:13.307338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:13.307338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:13.307730 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:13.444171 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:13.444790 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:13.451208 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:13.451696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:13.452131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:13.453045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:13.453507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:13.453931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:13.526040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:13.533791 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8e73c96f-b95e-4295-8db3-cbbebb008746 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1672 microversion: 2.1 time: 0.247814 Aug 10 08:51:13.539400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 498/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:13 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:13.608371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:13.616565 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-05a7565d-0d33-495f-ad04-02a8292949be tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1366 microversion: 2.1 time: 0.176775 Aug 10 08:51:13.617252 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 523/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:13 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:13.997526 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:13.999309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:14.005426 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.008152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.008152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.008152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.008152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.008554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.197202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:14.205340 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b6323985-9e89-46b7-b12c-3bde40e7a545 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.211804 Aug 10 08:51:14.205975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 499/1022] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:13 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:14.307714 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6cfec-568b-48f0-8921-cf60a016e438", "name": "network-vif-deleted", "tag": "7e14fb21-e61d-4a26-b59f-5532a3bd98dc"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:14.317228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.317704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.318138 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.330958 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] Creating event network-vif-deleted:7e14fb21-e61d-4a26-b59f-5532a3bd98dc for instance 77f6cfec-568b-48f0-8921-cf60a016e438 on hv-cinder-78102 Aug 10 08:51:14.338610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-34ff514b-d10d-446c-b39a-b9413b683804 req-4eeac36f-1fd9-4746-bc58-8f7fa8ad041d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034552 Aug 10 08:51:14.339951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 524/1023] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:14.556174 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:14.568338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:14.568338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.568338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.568338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.568803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.568803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.568803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.586877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:14.632420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:14.637509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:14.638214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:14.640731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-05e33230-68a8-4a11-9c73-2b0e69e58fc6 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1604 microversion: 2.1 time: 0.089826 Aug 10 08:51:14.641365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 500/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:14 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1604 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:14.658656 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.664571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.664571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.664571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.664571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.664951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.793327 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:14.800779 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-75e41e0e-40b9-4163-8614-13322197cae0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1556 microversion: 2.1 time: 0.167411 Aug 10 08:51:14.801353 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 525/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:14 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:14.821388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:14.821887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:14.828682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.831815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.831815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.831815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:14.831815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:14.832265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:14.911664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-773a7527-02ce-485e-8d13-fb82b68c5bfa tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094090 Aug 10 08:51:14.912316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 501/1026] 10.222.0.45 () {58 vars in 1275 bytes} [Wed Aug 10 08:51:14 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:15.231999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:15.233033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:15.244712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:15.246516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:15.247122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:15.248081 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:15.248747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:15.249335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:15.398042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:15.405601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-155bc7cf-00a8-4c46-8f6b-848678301360 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1261 microversion: 2.1 time: 0.182230 Aug 10 08:51:15.406227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 526/1027] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:15 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:15.666548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:15.666548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:15.671230 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:15.671788 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:15.672296 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:15.673049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:15.673579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:15.674090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:15.707247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:15.707739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:15.708179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:15.708638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lazy-loading 'fault' on Instance uuid 77f6cfec-568b-48f0-8921-cf60a016e438 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:51:15.985799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661a67fbdd6941889c706d2560c920a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd42ddf1ccf54e1598b65a08b08774b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:15.994164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e8e6de49-d3c5-4d7e-8a62-1e822407735e tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 200 len: 1327 microversion: 2.1 time: 0.335273 Aug 10 08:51:15.994851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 502/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:15 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 1327 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:16.353274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c6fd05-b0f9-4f2c-a0c0-e952c3de2629", "tag": "1c4397ca-a76f-4bf1-b313-636c28f45854"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:16.364013 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:16.364496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:16.365057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:16.376393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] Creating event network-changed:1c4397ca-a76f-4bf1-b313-636c28f45854 for instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 on hv-cinder-78102 Aug 10 08:51:16.381919 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-51f5a508-5aa8-4be9-882d-d427f538e365 req-673c62fd-331e-45f9-9471-7d682ef4f9f6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 Aug 10 08:51:16.382711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 527/1029] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:16.428348 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:16.429077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:16.435904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:16.436642 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:16.437236 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:16.438093 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:16.438870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:16.439450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:16.662771 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:16.671511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-fd4f1029-36c6-4179-916c-74d6f47e500f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1444 microversion: 2.1 time: 0.248132 Aug 10 08:51:16.672122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 503/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:16 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1444 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:16.693036 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:16.693729 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:16.699937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:16.700660 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:16.701092 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:16.701784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:16.702243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:16.702697 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:16.845733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:16.855632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9b54bba8-4d48-43f7-97cc-5cdc4380b834 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1444 microversion: 2.1 time: 0.167313 Aug 10 08:51:16.871004 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 528/1031] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:16 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:17.016871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:17.017490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:17.023901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:17.024389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:17.024824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:17.025527 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:17.026028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:17.026718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:17.042488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 HTTP/1.1 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:51:17.044090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:17.045937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '77f6cfec-568b-48f0-8921-cf60a016e438'} Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:51:17.051017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:17.052503 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:17.053870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:51:17.053870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-abda716e-cf20-4ff8-998f-72107879c0c8 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 404 len: 111 microversion: 2.1 time: 0.032642 Aug 10 08:51:17.053870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 504/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:17 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:51:17.058007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b09b5215-d8a6-4678-8c9f-50b2c7c466a9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '.version_select at 0x7fdef58b9940>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:17.164670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b09b5215-d8a6-4678-8c9f-50b2c7c466a9 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377151079" status: 202 len: 0 microversion: 2.1 time: 0.113107 Aug 10 08:51:17.165418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 529/1033] 10.222.0.45 () {58 vars in 1218 bytes} [Wed Aug 10 08:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377151079 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:51:19.104052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:19.115438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:19.115913 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:19.116563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:19.128664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] Creating event network-changed:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:51:19.133760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-017ade5e-afb3-4b1d-a72d-252d0bd1c952 req-526af8cb-92bf-4f29-bfb0-b8b76fdf7d16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033374 Aug 10 08:51:19.134362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 505/1034] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:20.477037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:20.477517 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:20.483357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:20.483832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:20.484264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:20.484949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:20.485400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:20.485820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:20.499598 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 HTTP/1.1 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:51:20.501256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.503575 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '77f6cfec-568b-48f0-8921-cf60a016e438'} Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:51:20.504444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.505696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.507170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:51:20.507170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7c1b433c-9277-4e21-94f4-cd9f4c889a11 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 404 len: 111 microversion: 2.1 time: 0.030274 Aug 10 08:51:20.507170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 530/1035] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:51:20 2022] DELETE /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:51:20.512015 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:20.512707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: 77f6cfec-568b-48f0-8921-cf60a016e438] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:20.519263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:20.519737 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:20.520196 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:20.521132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:20.521587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:20.522005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:20.534871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 HTTP/1.1 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:51:20.536492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.538118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '77f6cfec-568b-48f0-8921-cf60a016e438'} Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:51:20.539180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. Aug 10 08:51:20.540609 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:20.542245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance 77f6cfec-568b-48f0-8921-cf60a016e438 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:51:20.542245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bbc40486-2afd-4597-8ce7-a31266af3841 tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438" status: 404 len: 111 microversion: 2.1 time: 0.030010 Aug 10 08:51:20.542245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 506/1036] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:20 2022] GET /compute/v2.1/servers/77f6cfec-568b-48f0-8921-cf60a016e438 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 08:51:21.830914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:21.831412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:21.837850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:21.842088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:21.842088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:21.842088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:21.842088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:21.842445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:21.853333 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 HTTP/1.1 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:51:21.854880 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.856447 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'ecd54a38-d75c-4105-80d5-02e459816b82'} Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:51:21.857359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.859095 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.860653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:51:21.860653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-81a05675-77e7-4a39-bb34-6b433f66a5bb tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 404 len: 111 microversion: 2.1 time: 0.029209 Aug 10 08:51:21.860653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 531/1037] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:51:21 2022] DELETE /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:51:21.865257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:21.870985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] [instance: ecd54a38-d75c-4105-80d5-02e459816b82] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:21.872226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:21.872708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:21.873145 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:21.873829 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:21.874289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:21.874739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:21.888532 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] HTTP exception thrown: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Request method failure captured: Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 HTTP/1.1 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829FBT8T15J29cUZlYkkcgeJu1ib2ogrPmiecPA0dETzOn5YwU7AaEbOPis2CBJEAlMFpYk0RC6mRYnWyfsUlSaS3SUrbKYgRtYOmEIr5TTWvqlQUCye8esuEVy61m4p-jFtX9-E7hyTGI44wtwMTFKXWz_877nCkLLejiA-6QgS42E Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:51:21.890024 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/fd42ddf1ccf54e1598b65a08b08774b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_fd42ddf1ccf54e1598b65a08b08774b7", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: fd42ddf1ccf54e1598b65a08b08774b7 Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-158003002 Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 661a67fbdd6941889c706d2560c920a2 Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeTestJSON-158003002-project Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.891695 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'ecd54a38-d75c-4105-80d5-02e459816b82'} Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:51:21.892592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. Aug 10 08:51:21.894397 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:51:21.897436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] Returning 404 to user: Instance ecd54a38-d75c-4105-80d5-02e459816b82 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:51:21.897436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-70685be4-f3b9-4e7a-a79f-932c5029faed tempest-AttachVolumeTestJSON-158003002 tempest-AttachVolumeTestJSON-158003002-project] 10.222.0.45 "GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82" status: 404 len: 111 microversion: 2.1 time: 0.030494 Aug 10 08:51:21.897436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 507/1038] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:21 2022] GET /compute/v2.1/servers/ecd54a38-d75c-4105-80d5-02e459816b82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:51:34.414437 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1689229139", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-993683958", "security_groups": [{"name": "tempest-secgroup-smoke-1632375263"}], "block_device_mapping_v2": [{"uuid": "19808bfd-9b46-45c8-827b-1180c1bcd4a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36df5925-02bb-4ea1-8602-8c8a2eea5405"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:34.424839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:34.425490 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:34.686361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] validate_networks() for [('36df5925-02bb-4ea1-8602-8c8a2eea5405', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:51:35.066593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:51:35.067112 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:51:35.067745 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:51:35.068215 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:51:35.068725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:51:35.078231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:35.078739 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:35.079169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:35.079930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:35.080512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:35.080932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:35.098017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:51:35.101943 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Getting quotas for user f1c7a90e90e5411f92eddd180ef9e27d and project b3230d51d63a4f9a9d47624c553242f4. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:51:35.160956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:51:35.173413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19808bfd-9b46-45c8-827b-1180c1bcd4a8',volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:51:35.570404 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-80c7c82c-a63d-4a15-9df4-7bce1b5db32e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.161158 Aug 10 08:51:35.571504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 532/1039] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:51:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:51:35.584003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-72ba6e11-467f-487e-8ba7-7289a572b81b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:35.588795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-72ba6e11-467f-487e-8ba7-7289a572b81b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:35.588795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=31 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:35.588795 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=28 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:35.807273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-72ba6e11-467f-487e-8ba7-7289a572b81b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:35.813840 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-72ba6e11-467f-487e-8ba7-7289a572b81b tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1094 microversion: 2.1 time: 0.234468 Aug 10 08:51:35.818661 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 508/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:35 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1094 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:36.836532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:36.837150 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:36.843908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:36.844493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:36.844947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:36.845629 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:36.846086 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:36.846527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:36.906856 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:36.915073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-230f2ca3-6d85-4ca5-a946-84f62d5628dc tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1136 microversion: 2.1 time: 0.083623 Aug 10 08:51:36.915638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 533/1041] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:36 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:37.941001 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:37.941600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:37.948144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:37.948633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:37.949077 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:37.949759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:37.950213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:37.950664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:38.012724 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:38.020366 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-dbc3fc2d-0c90-4e6a-93b2-181cd939c1ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1210 microversion: 2.1 time: 0.083166 Aug 10 08:51:38.020941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 509/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:37 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:39.053242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:39.054630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:39.063618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:39.070485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:39.071877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:39.072804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:39.077938 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:39.078956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:39.269099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:39.273292 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-62953bbd-075b-4aff-9d51-272601874e05 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1278 microversion: 2.1 time: 0.231751 Aug 10 08:51:39.273860 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 534/1043] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:39 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:39.762595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd55beab-3ddb-458d-9e74-a87a609ae69c", "tag": "4a958170-6a2b-45b4-b48f-7c8e5a4557be"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:39.776045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:39.776514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:39.779782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:39.789400 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] Creating event network-changed:4a958170-6a2b-45b4-b48f-7c8e5a4557be for instance cd55beab-3ddb-458d-9e74-a87a609ae69c on hv-cinder-78102 Aug 10 08:51:39.795283 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-bb8ed85e-33c9-45a7-8967-ddea9d00d1ad req-b95075a9-f74e-42b9-a7e8-7730d5b3f273 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043020 Aug 10 08:51:39.797239 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 510/1044] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:40.293444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:40.294049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:40.300448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:40.300928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:40.301956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:40.302698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:40.303153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:40.303570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:40.439535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:40.447283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-87ada50a-a41d-46d6-980b-d5905deb41b5 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.157635 Aug 10 08:51:40.447966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 535/1045] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:40 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:41.469506 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:41.470216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:41.476352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:41.476838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:41.477280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:41.477974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:41.478459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:41.478915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:41.617074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:41.624610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f07a61da-a82f-4327-814f-d26a856f5bd0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.159783 Aug 10 08:51:41.625188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 511/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:41 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:42.645282 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:42.645868 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:42.652812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:42.653285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:42.653720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:42.654402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:42.654877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:42.655299 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:42.826994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:42.835009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-585bc2a7-cb86-40b1-855a-153c44fe4e55 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.193838 Aug 10 08:51:42.837012 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 536/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:42 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:43.858779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:43.858779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:43.863437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:43.864026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:43.864671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:43.866017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:43.866750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:43.867369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:44.016433 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:44.024894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-197beb65-9157-4df7-b373-e08adbc35ee4 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.173172 Aug 10 08:51:44.025482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 512/1048] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:43 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:51:45.045380 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:45.045992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:45.056542 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:45.058414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:45.058886 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:45.059588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:45.060155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:45.060577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:45.091848 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:45.108843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:45.196786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:45.204267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-bf56fe22-3992-4ee6-b541-7e9d5a37f83f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.163023 Aug 10 08:51:45.204844 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 537/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:45 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:46.224577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:46.225164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:46.227757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:51:46.232409 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:46.232892 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:46.233326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:46.234176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:46.234630 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:46.235058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:46.373677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:46.381698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7fb88b49-343d-49b2-8557-c819aa2ce933 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.161115 Aug 10 08:51:46.382257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 513/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:46 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:47.402726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:47.403335 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:47.413903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:47.413903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:47.413903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:47.413903 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:47.414452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:47.414452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:47.543915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:47.551834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c1c810a2-ffd6-44b9-816d-2cf5de9bc7de tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.153059 Aug 10 08:51:47.552948 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 538/1051] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:47 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:48.573058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:48.573600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:48.580042 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:48.580534 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:48.580972 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:48.581670 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:48.582137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:48.582653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:48.720380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:48.728662 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-af96839c-b76d-40e4-9587-4d537a27b077 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.159539 Aug 10 08:51:48.729250 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 514/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:48 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:49.749379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:49.750117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:49.757283 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:49.757692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:49.758122 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:49.758850 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:49.759346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:49.759768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:49.892906 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:49.900799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-00405291-1b9a-4cd1-a86d-d6814baec925 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.155486 Aug 10 08:51:49.901361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 539/1053] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:49 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:50.721072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd55beab-3ddb-458d-9e74-a87a609ae69c", "name": "network-vif-plugged", "status": "completed", "tag": "4a958170-6a2b-45b4-b48f-7c8e5a4557be"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:50.732322 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:50.733949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:50.733949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:50.745699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] Creating event network-vif-plugged:4a958170-6a2b-45b4-b48f-7c8e5a4557be for instance cd55beab-3ddb-458d-9e74-a87a609ae69c on hv-cinder-78102 Aug 10 08:51:50.751023 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-f23069d7-b097-46bc-89a2-6e67dd5a1236 req-d2e38946-890e-46ed-a3fc-744b85e4fa8f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Aug 10 08:51:50.751643 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 515/1054] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:51:50.921047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:50.921640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:50.928169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:50.928640 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:50.929074 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:50.929765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:50.930218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:50.930685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:51.060325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:51.067874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a63ef307-b408-43aa-a2f9-2f8be8b02c67 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.150661 Aug 10 08:51:51.068476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 540/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:50 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:52.089853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:52.090490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:52.097228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:52.097700 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:52.098138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:52.099346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:52.099798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:52.100218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:52.236398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:52.245010 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1f4c4b8e-9f6d-4c6f-9f16-122ff5a99fff tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.159529 Aug 10 08:51:52.245913 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 516/1056] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:52 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:53.266379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:53.270148 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:53.275165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:53.276550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:53.277168 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:53.277890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:53.278349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:53.278803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:53.418990 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:53.426410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7604985b-cf64-400f-ab97-96b3de6f794e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1266 microversion: 2.1 time: 0.164116 Aug 10 08:51:53.427002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 541/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:53 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:54.446923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:54.447574 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:54.454057 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:54.454575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:54.455014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:54.455699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:54.456164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:54.456588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:54.591176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:54.599235 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9c2d4b96-f1f9-4374-8243-d70c3102ae74 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1452 microversion: 2.1 time: 0.155759 Aug 10 08:51:54.599802 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 517/1058] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:54 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:54.620591 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:51:54.621195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:51:54.627546 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:54.628026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:54.628458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:54.629133 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:54.629585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:54.630005 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:54.763038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:51:54.772058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7cae4ba9-592f-4b0c-a3c9-02b6042d149d tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1452 microversion: 2.1 time: 0.155193 Aug 10 08:51:54.772630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 542/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:51:54 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:51:56.786949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd55beab-3ddb-458d-9e74-a87a609ae69c", "tag": "4a958170-6a2b-45b4-b48f-7c8e5a4557be"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:51:56.796577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:51:56.797028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:51:56.797450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:51:56.809781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] Creating event network-changed:4a958170-6a2b-45b4-b48f-7c8e5a4557be for instance cd55beab-3ddb-458d-9e74-a87a609ae69c on hv-cinder-78102 Aug 10 08:51:56.815237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-9aa68ff4-7b1f-42d6-98ad-60a1372995eb req-944eee37-8407-4786-af75-89c5c1b927f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Aug 10 08:51:56.816068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 518/1060] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:52:10.490241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:10.503885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:10.503885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:10.503885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=62 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:10.503885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.503885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.504369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:10.504369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.504369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.504369 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:10.531914 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-29aa4dd8-cd1e-472b-9101-2cefab0723c6 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045807 Aug 10 08:52:10.532466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 543/1061] 10.222.0.45 () {60 vars in 1343 bytes} [Wed Aug 10 08:52:10 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:10.593946 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:10.594551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:10.596653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=24 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:10.597346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=48 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:10.602157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.602671 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.603105 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:10.603920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.604893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.605357 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:10.630113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:52:10.938005 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f6a5fc97-e94f-412c-b260-35adc9beb1c7 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 204 len: 0 microversion: 2.20 time: 0.348116 Aug 10 08:52:10.939444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 519/1062] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 08:52:10 2022] DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 08:52:10.947429 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:10.948044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:10.958538 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.961535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.961535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:10.961535 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:10.962066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:10.962672 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:11.093839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:11.101764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:11.103294 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:11.105083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-df944974-efb7-4c33-bfa2-0a08fa397cba tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.161357 Aug 10 08:52:11.105646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 544/1063] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:10 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:52:12.128970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:12.129658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:12.136317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:12.136806 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:12.137244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:12.137939 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:12.138396 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:12.138871 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:12.269575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:12.277587 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:12.279115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:12.280270 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-50c63b33-3ef0-48af-9031-7d78f1343c5d tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.155524 Aug 10 08:52:12.280825 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 520/1064] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:12 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:52:13.303552 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:13.307946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:13.310734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:13.311213 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:13.311667 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:13.312330 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:13.312832 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:13.313250 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:13.443646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:13.451772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:13.453410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:13.454624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c19d2e27-d65f-452b-ac3b-9fc80d49310e tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1722 microversion: 2.20 time: 0.155053 Aug 10 08:52:13.455257 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 545/1065] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:13 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:52:14.401543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0bae61f-bd65-476a-bfbb-e9a87ecef39a", "name": "network-vif-deleted", "tag": "19b5c0da-b1a2-4b9b-8c5e-31078965e869"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:52:14.412308 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:14.412849 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:14.413434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:14.425494 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] Creating event network-vif-deleted:19b5c0da-b1a2-4b9b-8c5e-31078965e869 for instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a on hv-cinder-78102 Aug 10 08:52:14.430421 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-59ac2794-2869-4571-a15a-c53b97389af4 req-7aa0bcee-7c2d-4c18-bcd1-af07f3188842 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Aug 10 08:52:14.431019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 521/1066] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:52:14.477344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:14.478628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:14.501107 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:14.501674 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:14.502241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:14.503033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:14.503561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:14.504075 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:14.571905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:14.579730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:14.581578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c316e7b121b4d859d9677edcb49be45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1554973bf4b4523b966a9d851b0244a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:14.582772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-377b52f6-f08c-4f1d-81e8-f2b70ae64ca3 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 200 len: 1655 microversion: 2.20 time: 0.109417 Aug 10 08:52:14.583313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 546/1067] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:14 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 08:52:15.607382 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:15.608075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:15.614113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:15.614634 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:15.615112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:15.615832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:15.616289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:15.616727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:15.630204 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a HTTP/1.1 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:52:15.631839 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:15.633627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'd0bae61f-bd65-476a-bfbb-e9a87ecef39a'} Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:52:15.634513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:15.636488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:15.637950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:52:15.637950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-41306821-5a8d-45a6-9ae8-5e94e4f16d56 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 404 len: 111 microversion: 2.20 time: 0.030705 Aug 10 08:52:15.637950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 522/1068] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:15 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:52:15.642887 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-193f4206-0cfd-498c-a8fa-29f0046dcc9b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '.version_select at 0x7fdef591c790>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:15.733234 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-193f4206-0cfd-498c-a8fa-29f0046dcc9b tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977906716" status: 204 len: 0 microversion: 2.20 time: 0.094121 Aug 10 08:52:15.733816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 547/1069] 10.222.0.45 () {60 vars in 1262 bytes} [Wed Aug 10 08:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977906716 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 08:52:17.717058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:17.717540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:17.723903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:17.724416 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:17.724856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:17.725566 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:17.726006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:17.726444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:17.740678 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a HTTP/1.1 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:52:17.742280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.746195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'd0bae61f-bd65-476a-bfbb-e9a87ecef39a'} Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:52:17.747201 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.748656 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.750162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:52:17.750162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e27f7b4e-6f0b-424c-b5ce-d7e0080f84f4 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 404 len: 111 microversion: 2.20 time: 0.030581 Aug 10 08:52:17.750162 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 523/1070] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 08:52:17 2022] DELETE /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:52:17.753053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:17.753662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: d0bae61f-bd65-476a-bfbb-e9a87ecef39a] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:17.760967 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:17.761442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:17.761893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:17.762573 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:17.763030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:17.763449 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:17.778448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a HTTP/1.1 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:52:17.780008 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.781693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'd0bae61f-bd65-476a-bfbb-e9a87ecef39a'} Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:52:17.782626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. Aug 10 08:52:17.784124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:17.785588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance d0bae61f-bd65-476a-bfbb-e9a87ecef39a could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:52:17.785588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ce0e784b-b11e-4206-a05b-f8f41f12b040 tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a" status: 404 len: 111 microversion: 2.20 time: 0.032205 Aug 10 08:52:17.785588 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 548/1071] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:17 2022] GET /compute/v2.1/servers/d0bae61f-bd65-476a-bfbb-e9a87ecef39a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 08:52:18.997325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:18.997816 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:19.004086 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:19.004502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:19.004937 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:19.005622 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:19.006072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:19.006517 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:19.022167 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda HTTP/1.1 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:52:19.023975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.025345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '4806864d-f9df-4b0b-9b3d-6a0e2e960fda'} Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:52:19.026122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.027420 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.028674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:52:19.028674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-63fb24b6-2915-46be-b54c-7db62429470c tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 404 len: 111 microversion: 2.20 time: 0.032289 Aug 10 08:52:19.028674 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 524/1072] 10.222.0.45 () {60 vars in 1280 bytes} [Wed Aug 10 08:52:18 2022] DELETE /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:52:19.033715 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:19.042638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] [instance: 4806864d-f9df-4b0b-9b3d-6a0e2e960fda] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:19.042638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:19.042638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:19.042638 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:19.043019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:19.043111 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:19.043512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:19.056566 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] HTTP exception thrown: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Request method failure captured: Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda HTTP/1.1 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi829ImXXV9TZ32L6-cZUC0Aan1iflFcH5B95iNzBvbIPmpl95IJb2HwGQK5yWQyQ9-Sekq7AqRevU68NeXOLd0UpzgzjpNod76FZvjEg5i16_9Yy13DZa5dGIh1XnXHBze9rQ_PPI7zacxgZjvaLSfO4ZEeKKAVnbWFkkfkz107zt9Vo Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:52:19.058756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a1554973bf4b4523b966a9d851b0244a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a1554973bf4b4523b966a9d851b0244a", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: a1554973bf4b4523b966a9d851b0244a Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-341573288 Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 0c316e7b121b4d859d9677edcb49be45 Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-341573288-project Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.060391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '4806864d-f9df-4b0b-9b3d-6a0e2e960fda'} Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:52:19.062002 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. Aug 10 08:52:19.064465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:52:19.065604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] Returning 404 to user: Instance 4806864d-f9df-4b0b-9b3d-6a0e2e960fda could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:52:19.065604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4b7fa3c3-6fa4-438e-9e21-9f8beb6543fe tempest-AttachVolumeShelveTestJSON-341573288 tempest-AttachVolumeShelveTestJSON-341573288-project] 10.222.0.45 "GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda" status: 404 len: 111 microversion: 2.20 time: 0.030234 Aug 10 08:52:19.065604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 549/1073] 10.222.0.45 () {60 vars in 1277 bytes} [Wed Aug 10 08:52:19 2022] GET /compute/v2.1/servers/4806864d-f9df-4b0b-9b3d-6a0e2e960fda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 08:52:36.626772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-459534372", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:52:36.635216 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:36.636064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:36.681072 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] validate_networks() for None {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:52:37.220677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:52:37.221096 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:52:37.221566 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:52:37.222022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:52:37.222431 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:52:37.231334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:37.231809 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:37.232237 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:37.232947 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:37.233395 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:37.233812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:37.250393 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Getting quotas for project ed5cde0a122f462ea2ba2888ffedf603. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:52:37.254380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Getting quotas for user a9159dfe492c48dd88fb72785cbf36c7 and project ed5cde0a122f462ea2ba2888ffedf603. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:52:37.265016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:52:37.267261 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:52:37.395598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-21c18358-81b3-4af1-b248-6b907a51ab40 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773146 Aug 10 08:52:37.396243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 525/1074] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 08:52:37.407528 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-814bf03e-0a86-4b58-94a9-4354f3d8a407 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:37.408167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-814bf03e-0a86-4b58-94a9-4354f3d8a407 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:37.410198 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:37.410879 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=28 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:37.464630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-814bf03e-0a86-4b58-94a9-4354f3d8a407 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:37.474766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-814bf03e-0a86-4b58-94a9-4354f3d8a407 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1214 microversion: 2.1 time: 0.071633 Aug 10 08:52:37.475343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 550/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:37 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:38.496091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:38.496708 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:38.503551 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:38.504043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:38.504479 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:38.505176 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:38.505636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:38.506068 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:38.567488 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:38.575529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d61f09b6-859c-47eb-944f-97b7528c0bab tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1218 microversion: 2.1 time: 0.083802 Aug 10 08:52:38.576095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 526/1076] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:38 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:52:39.599861 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:39.601871 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:39.612079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:39.629273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:39.629273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:39.629273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:39.629273 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:39.629637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:39.683522 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:39.692345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3d5cd50e-2c71-4222-b648-50d859039c8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1274 microversion: 2.1 time: 0.099180 Aug 10 08:52:39.692716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 551/1077] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:39 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:40.714624 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:40.715917 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:40.723149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:40.723392 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:40.724058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:40.725405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:40.726043 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:40.726496 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:40.973614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:40.981051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5f53bf9f-4d69-4112-8c58-9993eba3c543 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.271410 Aug 10 08:52:40.981614 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 527/1078] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:40 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:41.417003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3dc16a-2474-4bb4-9982-2f4c39f522e9", "tag": "ce59a49e-80dd-4aea-baf9-0c714e50e638"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:52:41.428063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:41.428541 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:41.432297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:41.440659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] Creating event network-changed:ce59a49e-80dd-4aea-baf9-0c714e50e638 for instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 on hv-cinder-78102 Aug 10 08:52:41.445671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-9992eec6-e99d-4087-86d0-f929bbf508d6 req-111aa11a-0bfb-4711-9045-b1e66e021800 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032417 Aug 10 08:52:41.446264 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 552/1079] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:52:42.001295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:42.004465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:42.008267 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:42.008750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:42.009186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:42.009875 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:42.010323 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:42.010775 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:42.214904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:42.222934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0e25a777-d975-4ab8-928e-1408fed22a0c tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.225645 Aug 10 08:52:42.223753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 528/1080] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:41 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:43.243813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:43.244506 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:43.250704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:43.251188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:43.251622 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:43.252306 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:43.252756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:43.253178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:43.385323 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:43.391344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aa5e4b62-a3d8-4f74-ae95-76b41bcd9cfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.152110 Aug 10 08:52:43.391935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 553/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:43 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:44.411881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:44.412481 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:44.418853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:44.419326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:44.419753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:44.420432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:44.420888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:44.421307 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:44.552217 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:44.559599 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-c9e73a36-50d6-4b65-ab1f-c2b1de4e04ea tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.151524 Aug 10 08:52:44.560202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 529/1082] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:44 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:45.582094 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:45.582816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:45.589370 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:45.589876 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:45.590313 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:45.591063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:45.591513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:45.592022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:45.722509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:45.730034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-45482814-e1c4-4c38-af29-7079dc691dca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.152683 Aug 10 08:52:45.730626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 554/1083] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:45 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:46.752461 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:46.753853 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:46.763415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:46.765341 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:46.765997 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:46.767718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:46.768597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:46.769186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:46.949838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:46.958085 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0df9638a-9d60-4d91-b58c-2c35c72a13ca tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.211249 Aug 10 08:52:46.958687 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 530/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:46 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:47.978118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:47.978752 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:47.981291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:47.986994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:47.987479 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:47.987912 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:47.988596 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:47.989047 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:47.989473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:48.133753 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:48.136881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-aae2c8f8-c2d9-415a-8447-a887d1c307f6 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.162575 Aug 10 08:52:48.137451 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 555/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:47 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:48.840064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3dc16a-2474-4bb4-9982-2f4c39f522e9", "name": "network-vif-plugged", "status": "completed", "tag": "ce59a49e-80dd-4aea-baf9-0c714e50e638"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:52:48.845025 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:48.845711 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=6 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:52:48.851589 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:48.852074 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:48.852521 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:48.865954 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] Creating event network-vif-plugged:ce59a49e-80dd-4aea-baf9-0c714e50e638 for instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 on hv-cinder-78102 Aug 10 08:52:48.871064 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-39259866-91b8-45d5-977d-28c5abeade7c req-cfab71c3-6a44-4463-86d1-dc7f6ca61382 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Aug 10 08:52:48.871646 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 531/1086] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:52:49.159377 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:49.160009 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:49.167413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:49.167413 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:49.167758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:49.168524 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:49.169038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:49.169466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:49.307446 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:49.318877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-83580d85-67f5-4862-b174-5422cb618371 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.160085 Aug 10 08:52:49.318877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 556/1087] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:49 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:50.336931 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:50.337733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:50.344783 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:50.345377 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:50.345868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:50.346585 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:50.347035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:50.347452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:50.480452 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:50.488653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7566630e-722e-46cd-ae3d-80e8096288e7 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.156424 Aug 10 08:52:50.489255 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 532/1088] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:50 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:51.516455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:51.517716 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:51.524646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:51.533331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:51.533331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:51.533331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:51.533331 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:51.533957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:51.661482 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:51.669443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-43576d3f-70d5-46ec-9a43-e7928149fdfe tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1314 microversion: 2.1 time: 0.156823 Aug 10 08:52:51.670119 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 557/1089] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:51 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:52.691044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:52.691784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:52.698364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:52.698874 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:52.699306 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:52.699985 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:52.700436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:52.700904 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:52.836029 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:52.844018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-acb44b78-ba99-409b-9710-cfe3090e3750 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1463 microversion: 2.1 time: 0.157029 Aug 10 08:52:52.844498 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 533/1090] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:52 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:52.887314 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:52.887798 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:52.895155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:52.895623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:52.896054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:52.897056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:52.897513 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:52.897935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:52.922825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:52:53.211719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-611c2d2a-2805-4179-8cc4-5307f029e745 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 204 len: 0 microversion: 2.1 time: 0.327920 Aug 10 08:52:53.212404 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 558/1091] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:52:52 2022] DELETE /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:52:53.220773 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:53.221378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:53.227276 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:53.227753 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:53.228186 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:53.228867 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:53.229319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:53.229739 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:53.355117 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:53.363007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2d773205-2201-4a50-873a-3e4707665cd1 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1469 microversion: 2.1 time: 0.146154 Aug 10 08:52:53.363583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 534/1092] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:53 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1469 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:54.385422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:54.386041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:54.393547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:54.394027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:54.394494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:54.395214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:54.395669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:54.396091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:54.751509 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:54.758858 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-29473c00-0087-4af2-901a-e4b291a64e98 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1469 microversion: 2.1 time: 0.377784 Aug 10 08:52:54.759422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 559/1093] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:54 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:55.456257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3dc16a-2474-4bb4-9982-2f4c39f522e9", "name": "network-vif-deleted", "tag": "ce59a49e-80dd-4aea-baf9-0c714e50e638"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:52:55.467094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:55.467575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:55.468008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:55.481137 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] Creating event network-vif-deleted:ce59a49e-80dd-4aea-baf9-0c714e50e638 for instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 on hv-cinder-78102 Aug 10 08:52:55.486423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-8d2dfc46-46f3-4385-9254-5f9cd545aa2d req-08d1cd75-63e4-477b-92ca-65c9e4dad779 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034582 Aug 10 08:52:55.487063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 535/1094] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:52:55.781497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:55.782202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:55.789837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:55.790322 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:55.790852 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:55.791572 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:55.791998 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:55.792421 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:55.825518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:55.826016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:55.826444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:55.826905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lazy-loading 'fault' on Instance uuid 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:52:55.866788 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:55.874236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-db94ba5c-8476-4360-aace-a4d280d321b2 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1304 microversion: 2.1 time: 0.097316 Aug 10 08:52:55.874826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 560/1095] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:55 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:56.897067 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:56.897768 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:56.903893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:56.904369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:56.904805 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:56.905487 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:56.905942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:56.906365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:56.937492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:56.937971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:56.938408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:56.938883 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lazy-loading 'fault' on Instance uuid 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:52:56.980371 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:56.987649 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0348b0b7-4c61-463c-973f-410c55cc9f8e tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1304 microversion: 2.1 time: 0.095612 Aug 10 08:52:56.988205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 536/1096] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:56 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:58.008224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:58.008834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:58.015416 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:58.015896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:58.016328 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:58.017091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:58.017544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:58.018223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:58.049272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:58.049684 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:58.050145 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:58.050616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lazy-loading 'fault' on Instance uuid 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:52:58.089859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:58.097890 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-2c1b25a9-c1d8-4ea9-9067-b9867ceb619d tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1304 microversion: 2.1 time: 0.093499 Aug 10 08:52:58.098455 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 561/1097] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:58 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:52:58.290195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:58.290807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:58.296974 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:58.297450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:58.298501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:58.299194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:58.299692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:58.300061 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:58.322060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-864478f4-2d23-4fbc-9629-5a85bacd494e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/ips" status: 200 len: 149 microversion: 2.1 time: 0.035703 Aug 10 08:52:58.322636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 537/1098] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:52:58 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:52:59.118813 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:52:59.119445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:52:59.125641 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:59.126665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:59.127098 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:59.127780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:59.128230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:59.128654 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:59.158562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:52:59.158950 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:52:59.159374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:52:59.159817 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lazy-loading 'fault' on Instance uuid 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:52:59.201836 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9159dfe492c48dd88fb72785cbf36c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5cde0a122f462ea2ba2888ffedf603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:52:59.209221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-afa4ac1a-71cf-4a35-afe1-fea7cbcbe68f tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 200 len: 1304 microversion: 2.1 time: 0.094299 Aug 10 08:52:59.209781 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 562/1099] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:52:59 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:53:00.229193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:00.229807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] [instance: 4f3dc16a-2474-4bb4-9982-2f4c39f522e9] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:00.235714 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:00.239012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:00.239012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:00.239012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:00.239012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:00.239381 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:00.251428 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] HTTP exception thrown: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Request method failure captured: Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 HTTP/1.1 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83HR-6GKO-_icZ9kbkrUX5EK2po2PnWnRl-we5ET55u5OOfwyJ5CxtlDFhwXD91_VnZwn1kUQCxdFS3fld_zqlnpnA3kwDTPB-nSbkJK1u6uHudwnt2AmVpclwB2U_zitwbqShLq0kGXR_GFvCSSBs9gigkyP4OxWjuKenLgBRqNBQM Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: ed5cde0a122f462ea2ba2888ffedf603 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesNegativeTest-675627200 Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:53:00.253573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ed5cde0a122f462ea2ba2888ffedf603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed5cde0a122f462ea2ba2888ffedf603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ed5cde0a122f462ea2ba2888ffedf603"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ed5cde0a122f462ea2ba2888ffedf603", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesNegativeTest-675627200 Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: ed5cde0a122f462ea2ba2888ffedf603 Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesNegativeTest-675627200 Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesNegativeTest-675627200-project Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: a9159dfe492c48dd88fb72785cbf36c7 Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesNegativeTest-675627200-project Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. Aug 10 08:53:00.255205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '4f3dc16a-2474-4bb4-9982-2f4c39f522e9'} Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:00.256091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. Aug 10 08:53:00.257434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:00.258703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] Returning 404 to user: Instance 4f3dc16a-2474-4bb4-9982-2f4c39f522e9 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:00.258703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-73fa069c-fe13-4924-a60d-7cd78434f8e4 tempest-VolumesNegativeTest-675627200 tempest-VolumesNegativeTest-675627200-project] 10.222.0.45 "GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9" status: 404 len: 111 microversion: 2.1 time: 0.029817 Aug 10 08:53:00.258703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 538/1100] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:00 2022] GET /compute/v2.1/servers/4f3dc16a-2474-4bb4-9982-2f4c39f522e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:02.000225 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dffa829-9273-4a47-9dc6-b439e687c5db"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:53:02.002690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:02.009996 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:02.010494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:02.010970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:02.011657 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:02.012169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:02.012644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:06.494899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4c5b5349-fb59-4a43-a256-9c2730c01abb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "POST /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.499509 Aug 10 08:53:06.495556 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 563/1101] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:53:01 2022] POST /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 194 bytes in 4501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:19.584918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:19.585436 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:19.588106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:19.588832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=68 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:19.593528 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:19.594030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:19.594512 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:19.595208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:19.595667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:19.596094 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:19.678963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lazy-loading 'services' on Instance uuid 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:53:19.902417 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-12fcbea0-89da-429f-a831-5e60f73100d9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments/0dffa829-9273-4a47-9dc6-b439e687c5db" status: 202 len: 0 microversion: 2.1 time: 0.321840 Aug 10 08:53:19.903196 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 539/1102] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:53:19 2022] DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments/0dffa829-9273-4a47-9dc6-b439e687c5db => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:53:19.909235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:19.910361 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:19.914561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:19.917230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:19.923996 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:19.924477 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:19.924910 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:19.925603 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:19.926054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:19.926492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:19.955670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-970773a8-cbb4-4646-af74-bfc7453716c1 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047893 Aug 10 08:53:19.956220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 564/1103] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:19 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:20.969673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:20.972022 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:20.979465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:20.979941 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:20.980372 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:20.981047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:20.981502 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:20.981918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:21.009646 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8744430c-9f42-4ab1-8915-06334e2d2cfd tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044867 Aug 10 08:53:21.010179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 540/1104] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:20 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:22.022343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:22.024555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:22.031924 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:22.032344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:22.032773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:22.033448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:22.033896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:22.034318 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:22.062922 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-709c562a-31b5-44bc-bc5d-7d6b2f208195 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 10 08:53:22.063471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 565/1105] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:22 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:22.227709 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:53:22.228150 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 08:53:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 08:53:23.075108 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:23.077271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:23.083657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:23.084133 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:23.084564 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:23.085241 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:23.085688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:23.086106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:23.114152 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-25842546-d33e-459d-b283-f899d5b9938c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Aug 10 08:53:23.115206 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 541/1106] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:23 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:24.127045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:24.129079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:24.136132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:24.136604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:24.137034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:24.137706 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:24.138153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:24.138594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:24.167773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-826a81a9-b9b3-4cac-b2eb-507df492aefe tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 10 08:53:24.168320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 566/1107] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:24 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:25.179784 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:25.182010 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:25.188288 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:25.188763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:25.189194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:25.189876 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:25.190328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:25.190826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:25.219752 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-02d4c33a-e8a6-4541-862b-1bb285e0024b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Aug 10 08:53:25.220312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 542/1108] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:25 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:26.232488 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:26.234664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:26.241915 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:26.242417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:26.242877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:26.243557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:26.244011 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:26.244430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:26.273187 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-62e4a536-0c0e-423c-b58c-1bc399082683 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Aug 10 08:53:26.273730 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 567/1109] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:26 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:27.285640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:27.287728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:27.294039 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:27.294543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:27.294979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:27.295654 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:27.296101 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:27.296517 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:27.325293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d2c5d04b-4945-4cf3-ac4b-5829c699e21b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Aug 10 08:53:27.325845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 543/1110] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:27 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:28.338241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:28.340444 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:28.346956 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:28.347442 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:28.347881 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:28.348570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:28.349695 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:28.350123 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:28.380195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3c9ec83a-7959-466c-b0d1-c95e0a7af85b tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 Aug 10 08:53:28.380750 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 568/1111] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:28 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:29.392957 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:29.395032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:29.401277 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:29.401762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:29.402193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:29.402900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:29.403349 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:29.403768 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:29.432486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1014679e-1fce-4737-a2be-2a4da7dab392 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 10 08:53:29.433025 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 544/1112] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:29 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:30.445144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:30.447318 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:30.453708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:30.454184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:30.454665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:30.455350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:30.455804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:30.456229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:30.484859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-3f40e5f3-8a14-43eb-b091-5b283216cfa3 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Aug 10 08:53:30.485404 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 569/1113] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:30 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:31.496920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:31.499281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:31.511388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:31.511388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:31.511388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:31.511388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:31.511706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:31.511706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:31.539293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-4cd26838-6261-4fa7-9f98-9288afd5ada0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Aug 10 08:53:31.539741 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 545/1114] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:31 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:32.552056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:32.554884 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:32.561274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:32.561761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:32.562204 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:32.562930 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:32.563379 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:32.563804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:32.592389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4d9a8f3e-11fd-4463-a40f-686e0b96511c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Aug 10 08:53:32.592942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 570/1115] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:32 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:33.605081 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:33.607247 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:33.613539 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:33.614014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:33.614448 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:33.615153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:33.615608 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:33.616028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:33.644059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f60827c6-54d7-4717-9395-355c7c332661 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042916 Aug 10 08:53:33.644605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 546/1116] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:33 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:34.656041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:34.658279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:34.665386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:34.665877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:34.666424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:34.667145 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:34.667628 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:34.668054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:34.698968 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-92d849aa-757e-4c3b-8c94-a3a429b7f945 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Aug 10 08:53:34.699534 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 571/1117] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:34 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:35.714675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:35.716934 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:35.723376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:35.723864 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:35.724797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:35.725490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:35.725994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:35.726355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:35.756610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-63f79fa6-805b-49ee-bd4c-1128310d4596 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046098 Aug 10 08:53:35.757218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 547/1118] 10.222.0.45 () {58 vars in 1302 bytes} [Wed Aug 10 08:53:35 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 08:53:35.823120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:35.823754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:35.829932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:35.830493 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:35.830997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:35.831711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:35.832160 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:35.832578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:35.858692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:53:36.142432 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fbc4d471-099f-4329-9ab0-434b3d5e651c tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 204 len: 0 microversion: 2.1 time: 0.322645 Aug 10 08:53:36.143052 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 572/1119] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:53:35 2022] DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:53:36.151745 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:36.152350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:36.158116 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:36.158639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:36.159073 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:36.159755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:36.160202 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:36.160626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:36.287901 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:53:36.295469 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0d9a06e2-da4a-4a3f-b72d-696af0fa7115 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1680 microversion: 2.1 time: 0.147717 Aug 10 08:53:36.296035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 548/1120] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:36 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:53:37.317061 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:37.317682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:37.324237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:37.324720 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:37.325157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:37.325887 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:37.326342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:37.326805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:37.456104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:53:37.464248 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-652ba6ba-7f37-4d67-887d-59d1629a2cd0 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1680 microversion: 2.1 time: 0.151629 Aug 10 08:53:37.464814 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 573/1121] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:37 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:53:38.486159 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:38.486794 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:38.494148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:38.494638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:38.495942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:38.495942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:38.496359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:38.496727 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:38.706621 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:53:38.715555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f2d0e795-5132-40d5-a28b-939bf3bfe13f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1680 microversion: 2.1 time: 0.233422 Aug 10 08:53:38.716304 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 549/1122] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:38 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:53:39.550140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c6fd05-b0f9-4f2c-a0c0-e952c3de2629", "name": "network-vif-deleted", "tag": "1c4397ca-a76f-4bf1-b313-636c28f45854"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:53:39.573399 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:39.574018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:39.575091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:39.616939 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] Creating event network-vif-deleted:1c4397ca-a76f-4bf1-b313-636c28f45854 for instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 on hv-cinder-78102 Aug 10 08:53:39.623433 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-28dee279-f15e-43f3-8330-e2397b16c746 req-55e99b0e-6fed-44a0-85c7-828d1a7fe105 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239324 Aug 10 08:53:39.624420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 574/1123] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:39.737483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:39.738087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:39.745346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:39.745824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:39.746438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:39.747156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:39.747604 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:39.748193 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:39.839581 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4542138b7aa5446b8544dc766cbcb372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934ce9d029694762938d6a2264fad07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:53:39.847640 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-8f1ac923-7ab0-4363-88c6-5b361211e86f tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 200 len: 1326 microversion: 2.1 time: 0.114243 Aug 10 08:53:39.848647 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 550/1124] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:39 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:53:40.868699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:40.869633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:40.876359 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:40.876898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:40.877334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:40.878020 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:40.880238 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:40.880238 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:40.892929 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 HTTP/1.1 Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:53:40.894735 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:40.897118 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '89c6fd05-b0f9-4f2c-a0c0-e952c3de2629'} Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:40.898159 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:40.899783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:40.902069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:40.902069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-32c3da52-8e7b-40ac-b6e9-9853b722ce63 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 404 len: 111 microversion: 2.1 time: 0.031506 Aug 10 08:53:40.902069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 575/1125] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:40 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:40.905953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-93d625a8-61a8-40f9-80a4-839b65cd8ec9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '.version_select at 0x7fdef5141e50>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:40.990156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-93d625a8-61a8-40f9-80a4-839b65cd8ec9 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829588845" status: 202 len: 0 microversion: 2.1 time: 0.088446 Aug 10 08:53:40.991049 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 551/1126] 10.222.0.45 () {58 vars in 1221 bytes} [Wed Aug 10 08:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829588845 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:53:43.290372 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:43.290932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:43.297458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:43.297610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:43.298024 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:43.298734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:43.299197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:43.299601 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:43.312946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 HTTP/1.1 Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:53:43.314536 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.316199 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '89c6fd05-b0f9-4f2c-a0c0-e952c3de2629'} Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:43.317149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.318777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.321057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:43.321057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c3e35f00-4227-4f7f-9b7d-7ff8879c1a98 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 404 len: 111 microversion: 2.1 time: 0.030047 Aug 10 08:53:43.321057 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 576/1127] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:53:43 2022] DELETE /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:43.324434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:43.325046 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:43.332284 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:43.332761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:43.333188 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:43.334367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:43.334842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:43.335262 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:43.350759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 HTTP/1.1 Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:53:43.352406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.354003 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '89c6fd05-b0f9-4f2c-a0c0-e952c3de2629'} Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:43.355597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. Aug 10 08:53:43.356845 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:43.358138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:43.358138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-11fca39d-0083-4e20-a24f-346daa9317fc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629" status: 404 len: 111 microversion: 2.1 time: 0.033177 Aug 10 08:53:43.358138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 552/1128] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:43 2022] GET /compute/v2.1/servers/89c6fd05-b0f9-4f2c-a0c0-e952c3de2629 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 08:53:44.707042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:44.707542 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:44.713898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.714375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.714843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.715532 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.715983 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.716414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 HTTP/1.1 Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:53:44.736301 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.737994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '03f2033c-38d9-4a6b-bd49-66e788022276'} Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:44.738917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.740436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.742618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:44.742618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dcad31b7-3570-4f94-b4eb-a22fda6616bc tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 404 len: 111 microversion: 2.1 time: 0.032877 Aug 10 08:53:44.742618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 577/1129] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:53:44 2022] DELETE /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:44.745651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:44.746265 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 03f2033c-38d9-4a6b-bd49-66e788022276] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:44.752651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.757089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.757089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.757089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.757089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.757465 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.768408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 HTTP/1.1 Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:53:44.769772 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.771443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '03f2033c-38d9-4a6b-bd49-66e788022276'} Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:44.772813 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. Aug 10 08:53:44.774508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.781345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 03f2033c-38d9-4a6b-bd49-66e788022276 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:44.781345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-40ebf357-45c2-4e21-a7da-af0f66d27821 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276" status: 404 len: 111 microversion: 2.1 time: 0.030143 Aug 10 08:53:44.781345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 553/1130] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:44 2022] GET /compute/v2.1/servers/03f2033c-38d9-4a6b-bd49-66e788022276 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:44.781608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:44.781608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:44.786457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.786957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.787389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.788774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.789229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.789652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.802829 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de HTTP/1.1 Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:53:44.804393 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.806270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'f29c280c-b091-4dc5-afb8-89e58f6371de'} Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:44.807230 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.808774 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.810285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:44.810285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-894ff25d-e5fe-41d4-a123-7469786fc3cb tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 404 len: 111 microversion: 2.1 time: 0.030149 Aug 10 08:53:44.810285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 578/1131] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:53:44 2022] DELETE /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:44.815843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:44.816454 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: f29c280c-b091-4dc5-afb8-89e58f6371de] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:44.822456 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.823016 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.823443 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.824157 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:44.824605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:44.825027 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:44.839294 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de HTTP/1.1 Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:53:44.840814 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.842627 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'f29c280c-b091-4dc5-afb8-89e58f6371de'} Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:44.843573 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. Aug 10 08:53:44.845063 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:44.846383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance f29c280c-b091-4dc5-afb8-89e58f6371de could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:44.846383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a66e2c28-b15c-421a-adca-4fb7f28a572e tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de" status: 404 len: 111 microversion: 2.1 time: 0.030524 Aug 10 08:53:44.846383 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 554/1132] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:44 2022] GET /compute/v2.1/servers/f29c280c-b091-4dc5-afb8-89e58f6371de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:46.138751 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:46.141583 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:46.146297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:46.147026 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:46.147461 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:46.148160 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:46.148610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:46.149030 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:46.162988 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 HTTP/1.1 Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:53:46.165147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.166761 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '0db10e43-3a1e-4f21-a834-f8f9e85dbf94'} Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:46.167621 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.169064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.170764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:46.170764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-81ca8dcc-a9bb-4063-97a3-9039b3d976e5 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 404 len: 111 microversion: 2.1 time: 0.031718 Aug 10 08:53:46.170764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 579/1133] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:53:46 2022] DELETE /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:46.176558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:46.177263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] [instance: 0db10e43-3a1e-4f21-a834-f8f9e85dbf94] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:46.185266 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:46.185707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:46.186233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:46.186877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:46.187334 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:46.191411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:46.201394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] HTTP exception thrown: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Request method failure captured: Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 HTTP/1.1 Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi82-XAayV-2s4KZxdIUg87j49yEyXP4Z2BEHnlj3ePBQ6vVM9tciNEO3ESV0I9oBMcskOKBkLgTgaySLvGAAfLCO_ZIUwlmBJLkXAoi-1Ys_iw3cGvIxTgdwoF33oCXvi1kVAZZL5f8gm6pMfEHjDqeBu3zNV3QDg7EYDl0JwJHXAj1w Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:53:46.202963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/934ce9d029694762938d6a2264fad07d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/934ce9d029694762938d6a2264fad07d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_934ce9d029694762938d6a2264fad07d", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 934ce9d029694762938d6a2264fad07d Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-285936354 Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 4542138b7aa5446b8544dc766cbcb372 Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-AttachVolumeNegativeTest-285936354-project Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.204555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '0db10e43-3a1e-4f21-a834-f8f9e85dbf94'} Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:53:46.205468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. Aug 10 08:53:46.207013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:53:46.208817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] Returning 404 to user: Instance 0db10e43-3a1e-4f21-a834-f8f9e85dbf94 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:53:46.208817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-24340f0e-38df-404d-9e3c-327994188577 tempest-AttachVolumeNegativeTest-285936354 tempest-AttachVolumeNegativeTest-285936354-project] 10.222.0.45 "GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94" status: 404 len: 111 microversion: 2.1 time: 0.032074 Aug 10 08:53:46.208817 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 555/1134] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:46 2022] GET /compute/v2.1/servers/0db10e43-3a1e-4f21-a834-f8f9e85dbf94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:53:52.018738 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b541de34-5829-4ebe-8cc9-2e64add9f391 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Action: 'create', calling method: .version_select at 0x7fdef59ee310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2089881237"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:53:52.668418 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b541de34-5829-4ebe-8cc9-2e64add9f391 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.762619 Aug 10 08:53:52.671766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 580/1135] 10.222.0.45 () {60 vars in 1155 bytes} [Wed Aug 10 08:53:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 764 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 08:53:52.681747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9237195b-9494-49f3-8e45-af8a430f52ac tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef53dddc0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:52.729319 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9237195b-9494-49f3-8e45-af8a430f52ac tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 200 len: 345 microversion: 2.1 time: 0.051861 Aug 10 08:53:52.730013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 556/1136] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:53:52 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:53.744134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-64d1b5a7-618f-4657-afd4-c7d94682c6d7 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef5940280>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:53.790780 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-64d1b5a7-618f-4657-afd4-c7d94682c6d7 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 200 len: 345 microversion: 2.1 time: 0.051465 Aug 10 08:53:53.791349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 581/1137] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:53:53 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:54.805060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-979b81c4-c142-4ee7-b30f-c891ce37954d tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef52cbc10>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:54.851824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-979b81c4-c142-4ee7-b30f-c891ce37954d tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 200 len: 346 microversion: 2.1 time: 0.051653 Aug 10 08:53:54.852388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 557/1138] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:53:54 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:54.865003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-75f70187-4008-498b-bdca-1cda9e5ad9fb tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Action: 'create', calling method: .version_select at 0x7fdef8623040>, body: {"snapshot": {"volume_id": "a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1990425202"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:53:55.322581 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-75f70187-4008-498b-bdca-1cda9e5ad9fb tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.461670 Aug 10 08:53:55.323161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 582/1139] 10.222.0.45 () {60 vars in 1162 bytes} [Wed Aug 10 08:53:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:55.342723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-0dd381ae-eb2e-4b5b-b29f-ff6ea5dea2c2 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef51a74c0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:55.374122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-0dd381ae-eb2e-4b5b-b29f-ff6ea5dea2c2 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.039557 Aug 10 08:53:55.374733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 558/1140] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:55 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:55.385826 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7ae6944e-a4e8-47ac-8ee0-655b2aeef932 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef591c310>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:55.415614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7ae6944e-a4e8-47ac-8ee0-655b2aeef932 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034106 Aug 10 08:53:55.416192 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 583/1141] 10.222.0.45 () {58 vars in 1140 bytes} [Wed Aug 10 08:53:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:55.427969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-23020dca-43c0-49c1-bbb1-5a147050cbd0 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef51878b0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:55.458918 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-23020dca-43c0-49c1-bbb1-5a147050cbd0 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.034742 Aug 10 08:53:55.459500 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 559/1142] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:55 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:56.468931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:56.469687 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:56.473986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-518c6372-2631-4856-bfe8-b8536e9d87c2 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef63494c0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:56.502786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-518c6372-2631-4856-bfe8-b8536e9d87c2 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.035116 Aug 10 08:53:56.503374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 584/1143] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:56 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:57.515594 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:57.516606 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:53:57.520459 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-18c5848c-9d19-49eb-852d-6730bde09832 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef51ae160>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:57.551208 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-18c5848c-9d19-49eb-852d-6730bde09832 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.036692 Aug 10 08:53:57.551807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 560/1144] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:57 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:53:58.564043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-afd17ddb-0284-418a-a5a2-b68a7fbe003c tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef57d4820>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:58.594132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-afd17ddb-0284-418a-a5a2-b68a7fbe003c tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.034489 Aug 10 08:53:58.594769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 585/1145] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:58 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:53:58.752140 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:53:58.752675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:58.759927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:58.760410 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:58.760850 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:58.761540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:58.762065 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:58.762511 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:58.784719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lazy-loading 'flavor' on Instance uuid ce07b4c5-dbd0-4cd3-9abd-9b130332a6af {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:53:59.047257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3aaac1f2-258a-4ba0-bb70-6ddb580df7af tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "POST /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.299747 Aug 10 08:53:59.047869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 561/1146] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:53:58 2022] POST /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:53:59.057170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:59.057791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:53:59.064401 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:59.064885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:59.065320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:59.066010 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:53:59.066485 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:53:59.066916 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:53:59.195527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:53:59.202801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-34dd71ba-2f26-424a-9e8e-ad8071def9c4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.150402 Aug 10 08:53:59.203368 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 586/1147] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:53:59 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:53:59.607343 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-7adbce5f-4fa3-48ba-b86b-4ed7486addad tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef5218c10>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:53:59.638961 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-7adbce5f-4fa3-48ba-b86b-4ed7486addad tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.035686 Aug 10 08:53:59.639530 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 562/1148] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:53:59 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:54:00.223496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:00.224220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:00.231201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:00.231685 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:00.232124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:00.232821 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:00.233280 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:00.233710 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:00.363972 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:00.372134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-44e25b98-d27b-4af4-b067-8a89c1d129bd tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.152485 Aug 10 08:54:00.372712 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 587/1149] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:00 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:00.651637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-13e468b4-1469-444e-86bb-b0cf8fb2fb5a tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef5d60d30>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:00.680906 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-13e468b4-1469-444e-86bb-b0cf8fb2fb5a tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 288 microversion: 2.1 time: 0.034147 Aug 10 08:54:00.681473 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 563/1150] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:54:00 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:00.692290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9e592349-8510-4a60-a844-1ff172e7f1bd tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef57e3670>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:00.828688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9e592349-8510-4a60-a844-1ff172e7f1bd tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 202 len: 0 microversion: 2.1 time: 0.138215 Aug 10 08:54:00.828688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 588/1151] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 10 08:54:00 2022] DELETE /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:54:00.835472 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cfd4289b-bf21-478a-87ad-0a86e187e056 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef5141a60>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:00.865703 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cfd4289b-bf21-478a-87ad-0a86e187e056 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 200 len: 287 microversion: 2.1 time: 0.034155 Aug 10 08:54:00.866260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 564/1152] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:54:00 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:01.393585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:01.394127 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:01.400091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:01.400570 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:01.403285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:01.403285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:01.403285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:01.403285 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:01.533612 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:01.541072 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-22c2acf6-e146-498f-9215-427bf0d5672c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.152194 Aug 10 08:54:01.541637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 589/1153] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:01 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:01.878723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-583eaa20-428a-43de-87f4-465fd3370fce tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef5218d30>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:01.902716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-583eaa20-428a-43de-87f4-465fd3370fce tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] HTTP exception thrown: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-583eaa20-428a-43de-87f4-465fd3370fce tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Request method failure captured: Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 HTTP/1.1 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83IffGBUvPGetLdwMx8pf-eWp1cHKIevGs9rA8sgkxNSpMK5RQRQddPQ0zIU8MdtOrjp_0w3sWlp1o_4W376RvdTeiz8QFlrYQ5cDhb5DOYRZ1Li9LcCshKaJSiLEvZsT95e36eJPxlWAlVrkiY6UkNE3mXhCX5s9Xy6YqLTInJdyjU Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:54:01.905106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e66a9995d44a4efaa817382daea43df5", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: c60f3403b7644561986335fa448d384e Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '82052149-62a6-42ec-84e2-5237b70b4bb9'} Aug 10 08:54:01.912943 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. (HTTP 404) (Request-ID: req-21bcc42b-0a97-4a80-84f9-9e75b6982d2c) Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.914547 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:01.915953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 08:54:01.917373 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-583eaa20-428a-43de-87f4-465fd3370fce tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Returning 404 to user: Snapshot 82052149-62a6-42ec-84e2-5237b70b4bb9 could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:01.918900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-583eaa20-428a-43de-87f4-465fd3370fce tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9" status: 404 len: 111 microversion: 2.1 time: 0.032193 Aug 10 08:54:01.919960 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 565/1154] 10.222.0.45 () {58 vars in 1251 bytes} [Wed Aug 10 08:54:01 2022] GET /compute/v2.1/os-snapshots/82052149-62a6-42ec-84e2-5237b70b4bb9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:54:01.920054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-40e03836-f5b0-487e-868c-44b041cfea66 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef57e3670>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:02.145492 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-40e03836-f5b0-487e-868c-44b041cfea66 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 202 len: 0 microversion: 2.1 time: 0.234132 Aug 10 08:54:02.146065 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 590/1155] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:54:01 2022] DELETE /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:54:02.155407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f206ae86-c52f-46fa-a9e2-c2ede1465708 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef519d700>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:02.201462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f206ae86-c52f-46fa-a9e2-c2ede1465708 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 200 len: 345 microversion: 2.1 time: 0.050367 Aug 10 08:54:02.202195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 566/1156] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:02 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:02.562819 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:02.563427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:02.569297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:02.569770 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:02.570726 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:02.571398 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:02.571845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:02.572265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:02.705547 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:02.713652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5a80e1fc-9f0b-4fce-9049-c04a6a56de8e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.154650 Aug 10 08:54:02.714217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 591/1157] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:02 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:03.216333 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9e8324bc-9bd0-4f18-9365-2f44c8e1c813 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef6da4430>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:03.244815 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-9e8324bc-9bd0-4f18-9365-2f44c8e1c813 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] HTTP exception thrown: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9e8324bc-9bd0-4f18-9365-2f44c8e1c813 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Request method failure captured: Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe HTTP/1.1 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83IffGBUvPGetLdwMx8pf-eWp1cHKIevGs9rA8sgkxNSpMK5RQRQddPQ0zIU8MdtOrjp_0w3sWlp1o_4W376RvdTeiz8QFlrYQ5cDhb5DOYRZ1Li9LcCshKaJSiLEvZsT95e36eJPxlWAlVrkiY6UkNE3mXhCX5s9Xy6YqLTInJdyjU Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:54:03.246799 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e66a9995d44a4efaa817382daea43df5", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: c60f3403b7644561986335fa448d384e Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe'} Aug 10 08:54:03.248419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. (HTTP 404) (Request-ID: req-79c0508a-a68b-4b80-9a54-eb812ff9d108) Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.249362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:03.250785 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 08:54:03.252069 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-9e8324bc-9bd0-4f18-9365-2f44c8e1c813 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Returning 404 to user: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-9e8324bc-9bd0-4f18-9365-2f44c8e1c813 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 404 len: 109 microversion: 2.1 time: 0.036244 Aug 10 08:54:03.253632 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 567/1158] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:03 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:54:03.258149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ff70aa00-e105-4407-97e1-128863f51498 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef57d4af0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:03.287025 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-ff70aa00-e105-4407-97e1-128863f51498 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] HTTP exception thrown: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ff70aa00-e105-4407-97e1-128863f51498 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Request method failure captured: Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: DELETE /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe HTTP/1.1 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83IffGBUvPGetLdwMx8pf-eWp1cHKIevGs9rA8sgkxNSpMK5RQRQddPQ0zIU8MdtOrjp_0w3sWlp1o_4W376RvdTeiz8QFlrYQ5cDhb5DOYRZ1Li9LcCshKaJSiLEvZsT95e36eJPxlWAlVrkiY6UkNE3mXhCX5s9Xy6YqLTInJdyjU Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:54:03.289614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e66a9995d44a4efaa817382daea43df5", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: c60f3403b7644561986335fa448d384e Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe'} Aug 10 08:54:03.291263 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. (HTTP 404) (Request-ID: req-afe76942-9e4e-421c-8c80-2242a7a28e6e) Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.292237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 08:54:03.293632 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 08:54:03.295045 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ff70aa00-e105-4407-97e1-128863f51498 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Returning 404 to user: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ff70aa00-e105-4407-97e1-128863f51498 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 404 len: 109 microversion: 2.1 time: 0.036880 Aug 10 08:54:03.296445 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 592/1159] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:54:03 2022] DELETE /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:54:03.299782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b70b32b-6392-44b4-aa3e-4f78f2112bb3 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Calling method '.version_select at 0x7fdef52a9dc0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:03.327380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-3b70b32b-6392-44b4-aa3e-4f78f2112bb3 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] HTTP exception thrown: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b70b32b-6392-44b4-aa3e-4f78f2112bb3 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Request method failure captured: Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe HTTP/1.1 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83IffGBUvPGetLdwMx8pf-eWp1cHKIevGs9rA8sgkxNSpMK5RQRQddPQ0zIU8MdtOrjp_0w3sWlp1o_4W376RvdTeiz8QFlrYQ5cDhb5DOYRZ1Li9LcCshKaJSiLEvZsT95e36eJPxlWAlVrkiY6UkNE3mXhCX5s9Xy6YqLTInJdyjU Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:54:03.329312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/e66a9995d44a4efaa817382daea43df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_e66a9995d44a4efaa817382daea43df5", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: e66a9995d44a4efaa817382daea43df5 Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-385304830 Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: c60f3403b7644561986335fa448d384e Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-385304830-project Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe'} Aug 10 08:54:03.330978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. (HTTP 404) (Request-ID: req-56a8fd73-fbe5-4bd5-bdc9-7e165eb055f0) Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.332126 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:03.333598 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 08:54:03.335017 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3b70b32b-6392-44b4-aa3e-4f78f2112bb3 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] Returning 404 to user: Volume a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3b70b32b-6392-44b4-aa3e-4f78f2112bb3 tempest-VolumesSnapshotsTestJSON-385304830 tempest-VolumesSnapshotsTestJSON-385304830-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe" status: 404 len: 109 microversion: 2.1 time: 0.034857 Aug 10 08:54:03.336482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 568/1160] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:03 2022] GET /compute/v2.1/os-volumes/a6f7e7fc-3be1-47dc-95d2-e375d4e0f5fe => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:54:03.734662 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:03.735312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:03.742274 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:03.742800 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:03.743242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:03.743941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:03.744406 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:03.744857 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:03.880801 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:03.891042 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1f0dbaab-79eb-4376-b6fd-6d84237bbcda tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.160067 Aug 10 08:54:03.891618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 593/1161] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:03 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:04.912930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:04.914147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:04.920447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:04.920923 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:04.921354 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:04.926567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:04.926567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:04.926567 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:05.062134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:05.070546 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-70475878-68ac-42b3-8c25-058d1dec4f35 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.162415 Aug 10 08:54:05.071148 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 569/1162] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:04 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:05.390616 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ac95df3b-8e14-4c07-8891-b51bb547dec4 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Action: 'create', calling method: .version_select at 0x7fdef57e3ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-772123106", "metadata": {"Type": "work"}}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:06.052937 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ac95df3b-8e14-4c07-8891-b51bb547dec4 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.773273 Aug 10 08:54:06.053557 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 594/1163] 10.222.0.45 () {60 vars in 1156 bytes} [Wed Aug 10 08:54:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 775 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 08:54:06.066099 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-68763d5a-c9ed-4f15-928b-824a0e627eda tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef53c3af0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:06.091634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:06.092255 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:06.098970 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:06.099460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:06.099905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:06.100610 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:06.101068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:06.101966 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:06.115553 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-68763d5a-c9ed-4f15-928b-824a0e627eda tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 200 len: 352 microversion: 2.1 time: 0.053111 Aug 10 08:54:06.116222 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 570/1164] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:06 2022] GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:06.236207 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:06.244452 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-dee35c25-96a6-45ec-b715-87d861e53dec tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.156788 Aug 10 08:54:06.245006 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 595/1165] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:06 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:07.129540 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f88524c9-4c08-4c12-badc-bdea0fe341ff tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef52c74c0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:07.178264 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f88524c9-4c08-4c12-badc-bdea0fe341ff tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 200 len: 353 microversion: 2.1 time: 0.053051 Aug 10 08:54:07.178887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 571/1166] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:07 2022] GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:07.202711 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-9e367f3d-f15a-48cb-afe9-1d2347b401ae tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef5745ca0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:07.241771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-9e367f3d-f15a-48cb-afe9-1d2347b401ae tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 200 len: 353 microversion: 2.1 time: 0.050682 Aug 10 08:54:07.242344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 596/1167] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:07 2022] GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:07.255722 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-63218ee6-3cbf-4748-90ec-455ba3e70185 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef5d7aca0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:07.265954 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:07.266590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:07.273784 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:07.275032 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:07.275459 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:07.276147 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:07.276690 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:07.277113 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:07.409585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:07.418046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-b10af536-b168-4df4-b682-efdcd53b136b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.156431 Aug 10 08:54:07.418633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 597/1168] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:07 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:07.467696 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-63218ee6-3cbf-4748-90ec-455ba3e70185 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 202 len: 0 microversion: 2.1 time: 0.215744 Aug 10 08:54:07.468271 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 572/1169] 10.222.0.45 () {58 vars in 1248 bytes} [Wed Aug 10 08:54:07 2022] DELETE /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:54:07.476202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fab0b8ea-44fb-46c5-899a-729139804a31 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef57e3ca0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:07.522561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fab0b8ea-44fb-46c5-899a-729139804a31 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 200 len: 352 microversion: 2.1 time: 0.050163 Aug 10 08:54:07.523128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 598/1170] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:07 2022] GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:08.439437 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:08.440050 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:08.446388 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:08.446905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:08.447339 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:08.448026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:08.448477 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:08.448900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:08.537666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-eac11a88-d15e-45d8-8799-1625e8fdf582 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Calling method '.version_select at 0x7fdef5834430>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:08.566317 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-eac11a88-d15e-45d8-8799-1625e8fdf582 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] HTTP exception thrown: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-eac11a88-d15e-45d8-8799-1625e8fdf582 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Request method failure captured: Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 HTTP/1.1 Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83ItimSQQ7du9KJ2ZTmjFEFxArHi0HnMx-Kryen2fqz6wOXBjCD3vcx62jyyz5xXdNpLVOQPBAp7_Z48WoTpwOuwB-C2u-8RJ2GhAqFrVlAr37JkaNsroSuGfCCEDMKXitgxO37yLAgH_ZnXCk0CtzjmgObQoPfrmcx-oE37pkezFNo Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 5f7bf9a7b18f47c396aed066e3b70ebf Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesGetTestJSON-1643387515 Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:54:08.567822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/5f7bf9a7b18f47c396aed066e3b70ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f7bf9a7b18f47c396aed066e3b70ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/5f7bf9a7b18f47c396aed066e3b70ebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_5f7bf9a7b18f47c396aed066e3b70ebf", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesGetTestJSON-1643387515 Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 5f7bf9a7b18f47c396aed066e3b70ebf Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesGetTestJSON-1643387515 Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesGetTestJSON-1643387515-project Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: 858bb0e1f1bc44a3abf429f235be670d Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesGetTestJSON-1643387515-project Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'cd7e401b-a3de-4b45-8590-0fbbf23a18e0'} Aug 10 08:54:08.569533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. (HTTP 404) (Request-ID: req-8cf22c1a-4da9-4955-87d3-0fb1faa4208b) Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:08.570634 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 08:54:08.572544 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 08:54:08.573846 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-eac11a88-d15e-45d8-8799-1625e8fdf582 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] Returning 404 to user: Volume cd7e401b-a3de-4b45-8590-0fbbf23a18e0 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-eac11a88-d15e-45d8-8799-1625e8fdf582 tempest-VolumesGetTestJSON-1643387515 tempest-VolumesGetTestJSON-1643387515-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0" status: 404 len: 109 microversion: 2.1 time: 0.035992 Aug 10 08:54:08.575235 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 599/1171] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:08 2022] GET /compute/v2.1/os-volumes/cd7e401b-a3de-4b45-8590-0fbbf23a18e0 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 08:54:08.595297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:08.603975 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-75877522-1932-42e5-9059-464bc3c106b4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.168715 Aug 10 08:54:08.605014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 573/1172] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:08 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:09.627686 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:09.628854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:09.636985 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:09.650221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:09.650221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:09.650221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:09.650221 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:09.651510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:09.772585 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:09.780494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f18ebc17-24ab-4896-8913-37f0e7f33bac tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.158901 Aug 10 08:54:09.781049 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 600/1173] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:09 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:10.802312 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:10.803059 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:10.810121 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:10.810731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:10.811191 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:10.811893 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:10.812362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:10.812781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:10.954134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:10.962171 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-84c47561-b98d-4652-a5c3-8edc8b271d85 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.163287 Aug 10 08:54:10.962786 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 574/1174] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:10 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:11.984626 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:11.985661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:11.991946 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:11.992560 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:11.993410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:11.994132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:11.994577 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:11.995041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:12.129055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:12.136466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-91051700-6a5c-4de2-9f3b-8f04daf86785 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.156099 Aug 10 08:54:12.137033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 601/1175] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:11 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:12.594263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f3033c4e-881a-41e2-8430-b5aa3d6aad7f tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef53fea60>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:12.647047 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f3033c4e-881a-41e2-8430-b5aa3d6aad7f tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/41488e8b-1aab-4f6c-ba8f-f770e4cb0292" status: 200 len: 351 microversion: 2.1 time: 0.056825 Aug 10 08:54:12.647903 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 575/1176] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:12 2022] GET /compute/v2.1/os-volumes/41488e8b-1aab-4f6c-ba8f-f770e4cb0292 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:13.158606 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:13.159218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:13.165549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:13.168893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:13.168893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:13.168893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:13.168893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:13.169376 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:13.313700 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:13.321808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c2b91250-56fe-4abe-b070-46da136f3b8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.166591 Aug 10 08:54:13.322427 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 602/1177] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:13 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:14.334364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-45de1ebc-6f77-440d-b5a0-465604c91a4c tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef52c7b80>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:14.343048 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:14.343435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:14.350066 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.350668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.351195 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.351892 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.352375 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.352799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.386346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-45de1ebc-6f77-440d-b5a0-465604c91a4c tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/6d04b23f-e8b9-4e30-8eed-ab63a1b592ab" status: 200 len: 351 microversion: 2.1 time: 0.051842 Aug 10 08:54:14.386346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 576/1178] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:14 2022] GET /compute/v2.1/os-volumes/6d04b23f-e8b9-4e30-8eed-ab63a1b592ab => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:14.534867 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:14.541951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-40e7aeeb-e682-49dd-af13-ba32d837ba8d tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1508 microversion: 2.1 time: 0.202931 Aug 10 08:54:14.542539 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 603/1179] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:14 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:14.562196 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:14.562812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:14.568708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.569189 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.569618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.570355 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.570834 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.579378 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.600537 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124810) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 08:54:14.653079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "name": "network-vif-unplugged", "status": "completed", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:14.665514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.665990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.666575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.679298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.compute.server_external_events [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] Unable to find a host for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af. Dropping event network-vif-unplugged {{(pid=124809) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 08:54:14.680217 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-4e086b09-ea89-4f89-acf6-d612e9eb7283 req-8f1b1291-6c8d-4cf7-9574-e436edf7f72d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.167794 Aug 10 08:54:14.681318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 577/1180] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 169 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 08:54:14.912707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-10415d17-d634-4005-8975-1a264a1babd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "POST /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af/action" status: 202 len: 0 microversion: 2.1 time: 0.354509 Aug 10 08:54:14.913863 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 604/1181] 10.222.0.45 () {60 vars in 1278 bytes} [Wed Aug 10 08:54:14 2022] POST /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:54:14.921861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:14.926987 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:14.933004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.933004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.933004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:14.933004 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:14.933651 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:14.934098 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:15.097577 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:15.106329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ae4ca28c-8dee-40a0-a43f-8657dc557f71 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1516 microversion: 2.1 time: 0.188449 Aug 10 08:54:15.106940 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 578/1182] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:14 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:16.128746 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:16.129354 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:16.137272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:16.137762 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:16.138211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:16.138959 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:16.139448 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:16.139877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:16.274101 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:16.281487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-23491d2f-95e5-45c8-9687-84066a6c2e75 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1516 microversion: 2.1 time: 0.157437 Aug 10 08:54:16.282068 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 605/1183] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:16 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:17.136856 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f7c2ab02-c747-4161-b394-1a85658c88d8 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef5d70670>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.184210 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f7c2ab02-c747-4161-b394-1a85658c88d8 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/3175bf11-d8af-4aa6-a852-c55604013a46" status: 200 len: 350 microversion: 2.1 time: 0.051181 Aug 10 08:54:17.184807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 579/1184] 10.222.0.45 () {58 vars in 1245 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes/3175bf11-d8af-4aa6-a852-c55604013a46 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:17.199731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-17879169-044b-4d7b-b952-ee8f15b0c322 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef634a670>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.283847 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-17879169-044b-4d7b-b952-ee8f15b0c322 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090199 Aug 10 08:54:17.284584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 606/1185] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:17.299380 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f8768a84-6eeb-42a5-ac79-c835e574ac28 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef52cb430>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.302752 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.303349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:17.310422 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:17.310960 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:17.311614 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:17.312414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:17.312772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:17.313196 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:17.388990 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f8768a84-6eeb-42a5-ac79-c835e574ac28 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094042 Aug 10 08:54:17.389565 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 580/1186] 10.222.0.45 () {58 vars in 1149 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:17.403524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-57d14ba8-97c8-480a-857e-ef354ed739a5 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef52c7ee0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.462439 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:17.467905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-845f5d83-913c-4400-bba4-452965208883 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1518 microversion: 2.1 time: 0.169550 Aug 10 08:54:17.469007 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 607/1187] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:17.496164 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-57d14ba8-97c8-480a-857e-ef354ed739a5 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096808 Aug 10 08:54:17.496760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 581/1188] 10.222.0.45 () {58 vars in 1134 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:17.509593 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4ed791e2-82ce-43c0-94eb-eaee62d84130 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef596e280>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.593905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4ed791e2-82ce-43c0-94eb-eaee62d84130 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088137 Aug 10 08:54:17.594574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 608/1189] 10.222.0.45 () {58 vars in 1167 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:17.608550 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-333f96cd-f0a8-49b9-b692-4c3e2af16d0d tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef52c74c0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.690037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-333f96cd-f0a8-49b9-b692-4c3e2af16d0d tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085268 Aug 10 08:54:17.690635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 582/1190] 10.222.0.45 () {58 vars in 1170 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:17.703778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7355a045-2c26-49df-9ad3-cad01be718c3 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef5834d30>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.783652 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7355a045-2c26-49df-9ad3-cad01be718c3 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083557 Aug 10 08:54:17.784220 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 609/1191] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:17.798297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1009ae09-db74-4025-a982-273a155ed2a7 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdefa168ee0>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.883274 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1009ae09-db74-4025-a982-273a155ed2a7 tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088684 Aug 10 08:54:17.883847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 583/1192] 10.222.0.45 () {58 vars in 1188 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:17.897594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7e03614a-d203-48d8-bdc4-46a019f08cde tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] Calling method '.version_select at 0x7fdef576a0d0>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:17.981494 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7e03614a-d203-48d8-bdc4-46a019f08cde tempest-VolumesTestJSON-604711447 tempest-VolumesTestJSON-604711447-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088453 Aug 10 08:54:17.982116 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 610/1193] 10.222.0.45 () {58 vars in 1155 bytes} [Wed Aug 10 08:54:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:18.492315 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:18.493658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:18.502078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:18.502563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:18.503010 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:18.503716 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:18.504177 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:18.504633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:18.733154 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:18.741147 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-035c55a3-c981-475b-a16d-2c5293cc78e2 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.254102 Aug 10 08:54:18.742038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 584/1194] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:18 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:19.763998 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:19.764516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:19.770682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:19.771162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:19.771594 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:19.772279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:19.772731 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:19.773182 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:19.973607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:19.981275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-95454f62-521a-43b8-83cd-d9f72729fcd4 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.222179 Aug 10 08:54:19.981840 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 611/1195] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:19 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:21.002793 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:21.003470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:21.010657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:21.011138 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:21.011575 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:21.012257 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:21.012710 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:21.013141 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:21.153902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:21.161475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f3cec69a-2274-4e8a-9f4b-7036780f3558 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.162515 Aug 10 08:54:21.162048 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 585/1196] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:20 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:22.182664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:22.183289 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:22.189699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:22.190174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:22.190636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:22.191527 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:22.192144 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:22.192563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:22.210216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:22.327249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:22.334613 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-af03ef9d-c798-4a2b-a7fd-bdb81b97e36e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.155863 Aug 10 08:54:22.346942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 612/1197] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:22 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:23.356442 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:23.357058 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:23.363462 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:23.364045 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:23.364485 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:23.365180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:23.365639 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:23.366070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:23.502621 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:23.510499 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-965dae6d-cb00-4828-948d-1d1e0bd91a49 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.158408 Aug 10 08:54:23.511279 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 586/1198] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:23 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:24.531717 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:24.532412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:24.539325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:24.539805 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:24.540237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:24.540925 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:24.541389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:24.541806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:24.672001 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:24.679516 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e32ea8f9-5880-445c-84dd-33a6f3c53750 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.151914 Aug 10 08:54:24.680155 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 613/1199] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:24 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:25.701657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:25.702273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:25.708860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:25.709344 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:25.709779 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:25.710563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:25.710944 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:25.711368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:25.851037 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:25.858894 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-af326b6f-bec3-4cff-aef5-a2e1d0c94a05 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.161662 Aug 10 08:54:25.859535 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 587/1200] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:25 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:26.880267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:26.880928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:26.887486 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:26.887992 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:26.888425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:26.889120 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:26.889578 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:26.890245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:27.028079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:27.036664 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-f3e37f18-d1f9-48e8-b663-37a55e43642f tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.160312 Aug 10 08:54:27.037231 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 614/1201] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:26 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:28.057868 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:28.058490 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:28.065078 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:28.068571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:28.068571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:28.068571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:28.068571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:28.068981 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:28.206018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:28.214172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-79c5d8d3-be66-41a8-b5b3-78ce5205dac1 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.160917 Aug 10 08:54:28.214780 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 588/1202] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:28 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:28.609430 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "name": "network-vif-plugged", "status": "completed", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:28.620043 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:28.621434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:28.621434 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:28.632201 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] Creating event network-vif-plugged:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:54:28.637942 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-89a25341-1bd9-477c-b722-20a9c5684ff4 req-96288ab1-5935-4a4b-9b81-fe432a4212c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Aug 10 08:54:28.638558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 615/1203] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:29.235870 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:29.236403 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:29.238689 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=23 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:29.243281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:29.243759 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:29.244189 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:29.245451 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:29.245912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:29.246328 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:29.250401 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:29.385514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:29.393122 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2067beb7-96f0-40d5-9dae-d263fe69355a tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.161207 Aug 10 08:54:29.393760 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 589/1204] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:29 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:30.416149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:30.416885 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:30.418795 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:30.423587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:30.424062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:30.424503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:30.425185 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:30.425635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:30.426055 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:30.558037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:30.565669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-208d2b15-d94f-46b0-8deb-4e203ccf2f19 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1574 microversion: 2.1 time: 0.154416 Aug 10 08:54:30.566241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 616/1205] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:30 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:31.586979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:31.587616 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:31.595653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:31.596142 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:31.596584 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:31.597369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:31.597897 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:31.598331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:31.725415 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:31.732808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-67fbfeee-a04c-419f-9b65-396bfc0b040c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1561 microversion: 2.1 time: 0.150031 Aug 10 08:54:31.733374 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 590/1206] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:31 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:42.545242 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:42.545742 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:42.547902 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:42.548555 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=22 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:42.551625 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd55beab-3ddb-458d-9e74-a87a609ae69c", "tag": "4a958170-6a2b-45b4-b48f-7c8e5a4557be"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:42.553623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:42.554223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:42.554793 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:42.555696 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:42.556153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:42.557174 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:42.557492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:42.558153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=11 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:54:42.563165 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:42.563631 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:42.564233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:42.577245 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] Creating event network-changed:4a958170-6a2b-45b4-b48f-7c8e5a4557be for instance cd55beab-3ddb-458d-9e74-a87a609ae69c on hv-cinder-78102 Aug 10 08:54:42.582484 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-0071ba12-9612-4013-865a-2d0f3bf123e2 req-9e27f68f-1dd8-431d-bdf2-9570c55f6ea6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041903 Aug 10 08:54:42.583084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 591/1207] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:42.642637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:54:42.917044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4f143e75-5a20-4105-812b-db0c254d6e6c tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 204 len: 0 microversion: 2.1 time: 0.378815 Aug 10 08:54:42.917911 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 617/1208] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:54:42 2022] DELETE /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:54:42.927272 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:42.928350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:42.939563 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:42.956040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:42.956040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:42.956040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:42.956040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:42.957837 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:43.143438 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:43.151644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-dbd1be31-b0cd-4b4d-a86d-df0c5a76f451 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1577 microversion: 2.1 time: 0.228769 Aug 10 08:54:43.164914 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 592/1209] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:42 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:44.174084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:44.174953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:44.181837 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:44.182320 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:44.182789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:44.183481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:44.183936 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:44.184365 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:44.316420 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:44.324022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-de77a236-1503-4ec8-8c86-a015cae4872e tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1577 microversion: 2.1 time: 0.155085 Aug 10 08:54:44.330553 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 618/1210] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:44 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:45.345160 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:45.345835 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:45.352529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:45.353278 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:45.353713 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:45.354623 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:45.355318 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:45.355529 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:45.577572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:45.585032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-2aeb423c-33c0-4d1c-ba01-707a6a10fd02 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1577 microversion: 2.1 time: 0.244020 Aug 10 08:54:45.585596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 593/1211] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:45 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:46.197782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd55beab-3ddb-458d-9e74-a87a609ae69c", "name": "network-vif-deleted", "tag": "4a958170-6a2b-45b4-b48f-7c8e5a4557be"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:46.207188 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:46.207665 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:46.208099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:46.219476 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] Creating event network-vif-deleted:4a958170-6a2b-45b4-b48f-7c8e5a4557be for instance cd55beab-3ddb-458d-9e74-a87a609ae69c on hv-cinder-78102 Aug 10 08:54:46.224592 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-a82a8d6b-2b92-4838-9537-9b32d976b2aa req-15e22124-57b8-4f9a-93b7-7e269bb6ffcd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146737 Aug 10 08:54:46.225194 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 619/1212] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:46.605228 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:46.605797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:46.612225 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:46.612733 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:46.613172 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:46.613863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:46.614320 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:46.614781 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:46.675365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:46.682808 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b469c69f-bad5-46a5-ab3b-13413aff7b85 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1225 microversion: 2.1 time: 0.081537 Aug 10 08:54:46.696205 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 594/1213] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:46 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:47.706022 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:47.706812 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:47.713295 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:47.713768 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:47.714196 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:47.714899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:47.715350 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:47.715765 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:47.747237 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:47.747705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:47.748134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:47.748567 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid cd55beab-3ddb-458d-9e74-a87a609ae69c {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:54:47.789058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:47.797137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-7f7f2ca5-15d7-4c8a-bb44-9a2583d2fbd8 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1230 microversion: 2.1 time: 0.095730 Aug 10 08:54:47.797708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 620/1214] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:47 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:48.817927 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:48.818555 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:48.825519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:48.825994 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:48.826427 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:48.827123 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:48.827570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:48.827989 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:48.857287 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:48.857755 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:48.858189 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:48.858658 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid cd55beab-3ddb-458d-9e74-a87a609ae69c {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:54:48.898244 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:48.905592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-3d08d8e3-800c-45be-a380-255349c22ee3 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1230 microversion: 2.1 time: 0.091519 Aug 10 08:54:48.906156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 595/1215] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:48 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:49.926608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:49.927249 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:49.934183 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:49.934772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:49.935210 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:49.935896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:49.936349 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:49.936773 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:49.967149 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:49.967637 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:49.968067 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:49.968505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid cd55beab-3ddb-458d-9e74-a87a609ae69c {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:54:50.011099 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:50.018789 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-281b87e4-a815-44c9-b959-006c1f1e9e68 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1230 microversion: 2.1 time: 0.096070 Aug 10 08:54:50.019360 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 621/1216] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:49 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:51.038877 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:51.039386 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:51.045723 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:51.046207 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:51.046697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:51.047378 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:51.047866 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:51.048295 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:51.080030 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:51.080509 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:51.080950 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:51.081394 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid cd55beab-3ddb-458d-9e74-a87a609ae69c {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:54:51.124572 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:51.132338 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5194eacf-7202-4fa7-b3b1-b6ed2d0dfa36 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 200 len: 1230 microversion: 2.1 time: 0.097396 Aug 10 08:54:51.132920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 596/1217] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:51 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:52.153827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:52.154417 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: cd55beab-3ddb-458d-9e74-a87a609ae69c] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:52.160897 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:52.169649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:52.169649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:52.169649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:52.169649 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:52.170053 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:52.177129 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] HTTP exception thrown: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Request method failure captured: Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c HTTP/1.1 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83APqqazqZG-xlWG-KhcNcJtzvVhjkIalWdP1vTUt1JPrr5d7yS0Ks-fXpFD_SH-S8Ugz_-LM348e9IxOSMXLbS6ge67g-tiJVmAl5JMRNZaX7OgkkYRsac9hC8rYT8aztlxUIk5f-VPtAQYn7PY7uv96XpZMoP1xCtG61rCLpAz9Ck Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:54:52.178777 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3230d51d63a4f9a9d47624c553242f4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-TestVolumeBootPattern-48175985 Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: f1c7a90e90e5411f92eddd180ef9e27d Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. Aug 10 08:54:52.180518 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'cd55beab-3ddb-458d-9e74-a87a609ae69c'} Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:54:52.181688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. Aug 10 08:54:52.183334 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:54:52.184747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Returning 404 to user: Instance cd55beab-3ddb-458d-9e74-a87a609ae69c could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:54:52.184747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-33c8f773-9044-4789-8a07-8d1c884b6d47 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c" status: 404 len: 111 microversion: 2.1 time: 0.030935 Aug 10 08:54:52.184747 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 622/1218] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:52 2022] GET /compute/v2.1/servers/cd55beab-3ddb-458d-9e74-a87a609ae69c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:54:55.545851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:55.545851 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:55.548758 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b82cda-225a-419d-baf9-879e64f0e070", "tag": "f4903dd7-3b50-4fe0-9c5d-5d712f213d49"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:54:55.553240 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:55.554120 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:55.554912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:55.556411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:55.557032 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:55.557612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:55.560162 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:55.560949 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:55.561391 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:55.575409 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] Creating event network-changed:f4903dd7-3b50-4fe0-9c5d-5d712f213d49 for instance a7b82cda-225a-419d-baf9-879e64f0e070 on hv-cinder-78102 Aug 10 08:54:55.581894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-707630ff-0ce9-43e8-9f78-6dee73d35ce4 req-71695417-d8f9-42e9-8908-6bb3b995a70d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038035 Aug 10 08:54:55.582520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 623/1219] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:54:55.588169 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:54:55.878747 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e15877fa-8bd0-4176-b20d-c9c3ef438b18 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 204 len: 0 microversion: 2.1 time: 0.337569 Aug 10 08:54:55.879554 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 597/1220] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:54:55 2022] DELETE /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:54:55.890143 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:55.890870 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:55.897502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:55.897995 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:55.898436 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:55.899197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:55.899843 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:55.900272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:56.042371 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:56.052584 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-4cdd90ee-67c5-477b-9960-18d3a49fb0d1 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1578 microversion: 2.1 time: 0.168036 Aug 10 08:54:56.053184 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 624/1221] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:55 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:54:57.074920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:57.075618 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:57.082014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:57.082525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:57.082970 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:57.083663 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:57.084128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:57.084558 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:57.240236 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:57.247905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-91f4bb93-c633-4f4e-99af-6143fbdcb629 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1578 microversion: 2.1 time: 0.177767 Aug 10 08:54:57.248692 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 598/1222] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:57 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:58.269564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:58.270178 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:58.277051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:58.277533 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:58.277971 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:58.278703 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:58.279167 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:58.279596 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:58.424170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:58.431243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6d508a36-0b03-482f-9fc0-22573d8dcd7a tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1578 microversion: 2.1 time: 0.165799 Aug 10 08:54:58.431818 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 625/1223] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:58 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:54:59.451926 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:54:59.452470 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:54:59.458860 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:59.459345 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:59.459782 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:59.460480 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:54:59.460930 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:54:59.461355 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:54:59.596250 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:54:59.604486 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cc703935-ba77-459d-b736-d261881e7e87 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1578 microversion: 2.1 time: 0.156400 Aug 10 08:54:59.607348 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 599/1224] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:54:59 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:00.631607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:00.631607 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:00.632141 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:00.632530 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:00.632975 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:00.633669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:00.634202 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:00.634568 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:00.768823 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:00.777039 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c90eb4ab-102c-4a7a-b82c-3ef28b41c569 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1578 microversion: 2.1 time: 0.155889 Aug 10 08:55:00.777675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 626/1225] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:00 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:01.557226 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b82cda-225a-419d-baf9-879e64f0e070", "name": "network-vif-deleted", "tag": "f4903dd7-3b50-4fe0-9c5d-5d712f213d49"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:55:01.567362 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:01.567842 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:01.568281 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:01.580151 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] Creating event network-vif-deleted:f4903dd7-3b50-4fe0-9c5d-5d712f213d49 for instance a7b82cda-225a-419d-baf9-879e64f0e070 on hv-cinder-78102 Aug 10 08:55:01.585925 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-1bb5014d-f166-475f-a5f0-7f074236c709 req-21b54466-e760-4c6e-bd23-a464c74e9e4b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Aug 10 08:55:01.586538 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 600/1226] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:55:01.797175 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:01.797806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:01.804941 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:01.805426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:01.806051 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:01.806778 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:01.807241 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:01.807666 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:01.875243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:01.883165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-330a24e1-da87-4678-a75e-dd3ec1144a91 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1225 microversion: 2.1 time: 0.089877 Aug 10 08:55:01.883891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 627/1227] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:01 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:02.905905 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:02.906638 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:02.913606 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:02.914089 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:02.914545 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:02.915863 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:02.916317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:02.916736 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:02.949361 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:02.949847 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:02.950285 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:02.950765 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lazy-loading 'fault' on Instance uuid a7b82cda-225a-419d-baf9-879e64f0e070 {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:55:02.993189 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c7a90e90e5411f92eddd180ef9e27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3230d51d63a4f9a9d47624c553242f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:02.999955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-038bb14c-c463-4023-b134-e960444dd3ee tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 200 len: 1184 microversion: 2.1 time: 0.098368 Aug 10 08:55:03.000530 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 601/1228] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:02 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 1184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:04.021449 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:04.022064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: a7b82cda-225a-419d-baf9-879e64f0e070] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:04.028027 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.028508 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.028947 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.029630 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.030088 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.030549 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.044163 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] HTTP exception thrown: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Request method failure captured: Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 HTTP/1.1 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83APqqazqZG-xlWG-KhcNcJtzvVhjkIalWdP1vTUt1JPrr5d7yS0Ks-fXpFD_SH-S8Ugz_-LM348e9IxOSMXLbS6ge67g-tiJVmAl5JMRNZaX7OgkkYRsac9hC8rYT8aztlxUIk5f-VPtAQYn7PY7uv96XpZMoP1xCtG61rCLpAz9Ck Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:55:04.045766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3230d51d63a4f9a9d47624c553242f4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: f1c7a90e90e5411f92eddd180ef9e27d Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. Aug 10 08:55:04.047551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'a7b82cda-225a-419d-baf9-879e64f0e070'} Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:55:04.048877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. Aug 10 08:55:04.050564 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.051994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Returning 404 to user: Instance a7b82cda-225a-419d-baf9-879e64f0e070 could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:55:04.051994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a8737824-332f-44f0-84a2-74d33409c2a0 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070" status: 404 len: 111 microversion: 2.1 time: 0.029726 Aug 10 08:55:04.051994 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 628/1229] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:04 2022] GET /compute/v2.1/servers/a7b82cda-225a-419d-baf9-879e64f0e070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:55:04.545942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:04.546444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:04.552887 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.553368 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.553807 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.554519 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.554978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.555435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.568475 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] HTTP exception thrown: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Request method failure captured: Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: DELETE /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f HTTP/1.1 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83APqqazqZG-xlWG-KhcNcJtzvVhjkIalWdP1vTUt1JPrr5d7yS0Ks-fXpFD_SH-S8Ugz_-LM348e9IxOSMXLbS6ge67g-tiJVmAl5JMRNZaX7OgkkYRsac9hC8rYT8aztlxUIk5f-VPtAQYn7PY7uv96XpZMoP1xCtG61rCLpAz9Ck Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:55:04.570115 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3230d51d63a4f9a9d47624c553242f4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: f1c7a90e90e5411f92eddd180ef9e27d Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.571790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': '2ca6145f-1018-4b81-9e0c-9813a80b229f'} Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:55:04.573233 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.576387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Returning 404 to user: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:55:04.576387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1ea6e5e6-0823-4f3c-a2b2-f8cadfebf936 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 10 08:55:04.576387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 602/1230] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:55:04 2022] DELETE /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:55:04.580824 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:04.581503 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] [instance: 2ca6145f-1018-4b81-9e0c-9813a80b229f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:04.587460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.588899 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.589037 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.589705 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:04.590165 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:04.590693 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:04.603902 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] HTTP exception thrown: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Request method failure captured: Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f HTTP/1.1 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83APqqazqZG-xlWG-KhcNcJtzvVhjkIalWdP1vTUt1JPrr5d7yS0Ks-fXpFD_SH-S8Ugz_-LM348e9IxOSMXLbS6ge67g-tiJVmAl5JMRNZaX7OgkkYRsac9hC8rYT8aztlxUIk5f-VPtAQYn7PY7uv96XpZMoP1xCtG61rCLpAz9Ck Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:55:04.605414 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b3230d51d63a4f9a9d47624c553242f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b3230d51d63a4f9a9d47624c553242f4", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: b3230d51d63a4f9a9d47624c553242f4 Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-TestVolumeBootPattern-48175985 Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: f1c7a90e90e5411f92eddd180ef9e27d Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-TestVolumeBootPattern-48175985-project Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.607136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '2ca6145f-1018-4b81-9e0c-9813a80b229f'} Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:55:04.608054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. Aug 10 08:55:04.609675 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:55:04.611343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Returning 404 to user: Instance 2ca6145f-1018-4b81-9e0c-9813a80b229f could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:55:04.611343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-99eb8264-d802-4835-8c81-b050ec3b9a69 tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f" status: 404 len: 111 microversion: 2.1 time: 0.030006 Aug 10 08:55:04.611343 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 629/1231] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:04 2022] GET /compute/v2.1/servers/2ca6145f-1018-4b81-9e0c-9813a80b229f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:55:13.588190 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-442c6ccb-dcf0-4fcd-97cc-ba0fea8ccb8f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] Calling method '.version_select at 0x7fdef52c7040>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:13.598439 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:13.707650 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-442c6ccb-dcf0-4fcd-97cc-ba0fea8ccb8f tempest-TestVolumeBootPattern-48175985 tempest-TestVolumeBootPattern-48175985-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-993683958" status: 202 len: 0 microversion: 2.1 time: 0.123851 Aug 10 08:55:13.708113 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 603/1232] 10.222.0.45 () {58 vars in 1260 bytes} [Wed Aug 10 08:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-993683958 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:55:15.213100 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:55:15.213826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 08:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 08:55:40.994312 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1059055814", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "networks": [{"uuid": "a6cef1a0-ae6a-4612-b2b5-3917f55cb6ee"}]}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:55:41.003044 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:41.003692 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:41.050392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.network.neutron [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] validate_networks() for [('a6cef1a0-ae6a-4612-b2b5-3917f55cb6ee', None, None, None, None, None)] {{(pid=124810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:55:41.446091 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Flavor limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:55:41.446602 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Image limits 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:55:41.447078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Flavor pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:55:41.447487 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Image pref 0:0:0 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:55:41.447896 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.virt.hardware [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:55:41.456772 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:41.457191 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:41.457624 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:41.458346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:41.458831 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:41.459309 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:41.476214 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Getting quotas for project 4df0ddc35b0b452db6b3ad901e7aa892. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:55:41.480142 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.quota [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Getting quotas for user e04e4a6cd83b40698213d7a2c3714406 and project 4df0ddc35b0b452db6b3ad901e7aa892. Resources: {'ram', 'instances', 'cores'} {{(pid=124810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:55:41.491973 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Going to run 1 instances... {{(pid=124810) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:55:41.494227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:55:41.638974 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-65c67b9c-f1df-4b7c-9098-5d37aa532c3a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648242 Aug 10 08:55:41.639623 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 630/1233] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:55:41.650803 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a11c165b-7165-4f47-b01f-fb87fa03d5a4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:41.651411 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a11c165b-7165-4f47-b01f-fb87fa03d5a4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:41.654664 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:41.708008 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-a11c165b-7165-4f47-b01f-fb87fa03d5a4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:41.715449 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a11c165b-7165-4f47-b01f-fb87fa03d5a4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1219 microversion: 2.1 time: 0.068743 Aug 10 08:55:41.718722 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 604/1234] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:41 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:42.737019 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:42.742663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:42.744457 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:42.744944 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:42.745390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:42.746087 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:42.746571 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:42.746999 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:42.808993 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:42.817046 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-e72e4bca-4ed9-4d82-896c-8e5c7889c9b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1223 microversion: 2.1 time: 0.084480 Aug 10 08:55:42.817806 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 631/1235] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:42 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:43.837585 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:43.838179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:43.844953 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:43.845434 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:43.845866 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:43.846621 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:43.847070 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:43.847492 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:43.920044 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:43.932006 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-1e638aba-5607-44c7-8d83-b949c2562146 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1279 microversion: 2.1 time: 0.098541 Aug 10 08:55:43.932797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 605/1236] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:43 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:44.954310 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:44.954987 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:44.961587 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:44.962140 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:44.962668 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:44.963558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:44.964017 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:44.964471 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:45.106243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:45.113689 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-40251222-eafa-47bf-83e7-fcdc9c1872e9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.163975 Aug 10 08:55:45.115909 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 632/1237] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:44 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:55:45.481679 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d830b0-2a2c-43d9-a872-316c51f0dd9f", "tag": "095fe7ae-eb77-46c5-b192-5609e3d6611e"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:55:45.491706 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:45.492262 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:45.492762 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:45.504445 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] Creating event network-changed:095fe7ae-eb77-46c5-b192-5609e3d6611e for instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f on hv-cinder-78102 Aug 10 08:55:45.509309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-68c0ad34-aadb-4c15-be22-07ff234d0c09 req-6e90e1ee-1eb8-45e8-853c-e6bd65a0c3c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031294 Aug 10 08:55:45.509898 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 606/1238] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:55:46.134877 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:46.135512 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:46.142382 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:46.142841 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:46.143275 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:46.143969 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:46.144426 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:46.144851 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:46.307124 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:46.314894 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-004eda21-8dd3-4061-aecd-faa2e02e9c4c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.183983 Aug 10 08:55:46.315460 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 633/1239] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:46 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:47.337252 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:47.337902 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:47.344060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:47.344543 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:47.344982 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:47.345672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:47.346132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:47.346592 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:47.473579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:47.480984 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-ae879be8-e9d6-431c-a8f1-3ee8d5085b36 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.148487 Aug 10 08:55:47.481560 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 607/1240] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:47 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:48.502764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:48.505424 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:48.510018 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:48.510521 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:48.510953 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:48.511636 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:48.512084 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:48.512748 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:48.643669 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:48.651456 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-0c1a9c68-3944-450a-a2eb-7026529ec91a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.153130 Aug 10 08:55:48.652016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 634/1241] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:48 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:49.672153 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:49.672768 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:49.679298 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:49.686118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:49.686118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:49.686118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:49.686118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:49.686542 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:49.810408 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:49.818367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d8babff8-e6b0-4e69-b2ea-577c9f052389 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.150235 Aug 10 08:55:49.818971 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 608/1242] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:49 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:50.838699 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:50.839311 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:50.846243 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:50.846750 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:50.847265 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:50.847951 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:50.848400 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:50.848822 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:50.977504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:50.984986 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-183c222d-401f-4c74-9738-e2477a5ba7ae tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.150174 Aug 10 08:55:50.988864 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 635/1243] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:50 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:52.005605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:52.006220 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:52.008694 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:52.013657 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:52.014143 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:52.014612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:52.015303 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:52.015763 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:52.016812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:52.144881 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:52.152468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-b30ed736-c23e-4f68-87c5-41e7ea87cf71 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.150726 Aug 10 08:55:52.153038 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 609/1244] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:52 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:52.330366 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d830b0-2a2c-43d9-a872-316c51f0dd9f", "name": "network-vif-plugged", "status": "completed", "tag": "095fe7ae-eb77-46c5-b192-5609e3d6611e"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:55:52.335443 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:52.337803 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=6 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:55:52.341928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:52.342402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:52.342891 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:52.354136 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] Creating event network-vif-plugged:095fe7ae-eb77-46c5-b192-5609e3d6611e for instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f on hv-cinder-78102 Aug 10 08:55:52.359286 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-447542c6-923b-4110-a903-613a0c0b99a2 req-90975c51-0ccc-4aa8-9430-1a2ada936ae3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 Aug 10 08:55:52.360383 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 636/1245] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:55:53.172026 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:53.172693 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:53.179106 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:53.179589 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:53.180028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:53.180719 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:53.181182 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:53.181612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:53.306615 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:53.313956 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-99755632-852f-4a4a-b211-24038696e596 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.145794 Aug 10 08:55:53.314537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 610/1246] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:53 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:54.336062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:54.336754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:54.343173 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:54.343648 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:54.344078 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:54.345256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:54.345707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:54.346125 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:54.472495 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:54.479854 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-6f0cce89-3269-40bc-9b1d-ada3a76616b5 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1319 microversion: 2.1 time: 0.149113 Aug 10 08:55:54.480419 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 637/1247] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:54 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:55:55.500453 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:55:55.501060 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:55:55.507440 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:55.507915 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:55.508347 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:55.509052 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:55:55.509501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:55:55.509919 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:55:55.639826 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:55:55.647707 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-547fd9d7-d25c-4770-83de-951acc16ecfc tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1507 microversion: 2.1 time: 0.151085 Aug 10 08:55:55.648260 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 611/1248] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:55:55 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:17.414131 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb3004c-999d-41bb-870d-188251d77717", "device": "/dev/sdb"}} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:56:17.417069 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:17.419228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:17.420035 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=40 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:17.425003 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:17.425466 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:17.425898 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:17.426608 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:17.427058 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:17.427474 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:18.144815 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-cbee05a9-6249-4dbd-b192-1b510b4f147b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "POST /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734313 Aug 10 08:56:18.145605 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 638/1249] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:56:17 2022] POST /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:56:34.339062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:34.339590 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:34.341804 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:56:34.342227 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:34.342721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=38 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:34.347612 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:34.347928 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:34.348229 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:34.348671 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:56:34.349180 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:34.349888 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:34.350346 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:34.356369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:34.356615 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:34.357063 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:34.357932 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:34.369082 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] Creating event network-changed:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:56:34.374683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-a59ccf15-2384-4b53-9ad3-d764c5e69b3b req-74317be2-cb0d-49f2-8826-9e1389291450 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036781 Aug 10 08:56:34.375279 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 639/1250] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:56:34.381297 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:56:34.683019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-5df15248-fae2-4fd1-90af-4f901eb70df9 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 204 len: 0 microversion: 2.1 time: 0.347497 Aug 10 08:56:34.692365 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 612/1251] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:56:34 2022] DELETE /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 08:56:34.693458 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:34.694154 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:34.700952 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:34.701428 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:34.701853 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:34.702563 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:34.703073 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:34.703473 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:34.954529 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:34.960827 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-1597b25b-d495-4f0b-93bb-2c6e8ff2c68e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.272774 Aug 10 08:56:34.961576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 640/1252] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:34 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:35.983091 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:35.983789 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:35.990966 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:35.991447 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:35.991886 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:35.992570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:35.993028 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:35.993450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:36.174012 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:36.181732 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-bd7ab95b-1e5d-4b72-9416-0f91e457314c tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1567 microversion: 2.1 time: 0.203054 Aug 10 08:56:36.182293 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 613/1253] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:35 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:37.202682 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:37.203267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:37.209435 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:37.209912 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:37.210342 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:37.211054 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:37.211523 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:37.211923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:37.444506 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:37.452062 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-72f447a6-0a96-4a01-8252-9bde2259be9e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1450 microversion: 2.1 time: 0.253330 Aug 10 08:56:37.452639 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 641/1254] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:37 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1450 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 08:56:37.794423 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce07b4c5-dbd0-4cd3-9abd-9b130332a6af", "name": "network-vif-deleted", "tag": "b4ee46f3-fdda-4070-8518-9d0b1c39aeb7"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:56:37.804135 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:37.804608 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:37.805035 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:37.815569 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] Creating event network-vif-deleted:b4ee46f3-fdda-4070-8518-9d0b1c39aeb7 for instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af on hv-cinder-78102 Aug 10 08:56:37.820369 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-cdf98e41-5724-4a2a-ba10-20d9ae5d5018 req-8aaf01f7-0633-4603-8390-7ced66f420cb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Aug 10 08:56:37.820932 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 614/1255] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:56:38.472769 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:38.473380 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:38.479734 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:38.480219 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:38.480650 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:38.481336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:38.481791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:38.482211 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:38.545504 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:38.553561 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fbc374c3-957f-40b8-a0a3-9571ee18d887 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1382 microversion: 2.1 time: 0.084704 Aug 10 08:56:38.554132 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 642/1256] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:38 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:39.575912 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:39.576648 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:39.583597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:39.584501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:39.584501 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:39.585173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:39.585633 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:39.586046 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:39.647342 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:39.654797 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-93b4e85e-9f28-4a94-a1bb-10f7c9c6cdb6 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1382 microversion: 2.1 time: 0.083615 Aug 10 08:56:39.655359 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 615/1257] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:39 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:40.674862 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:40.675481 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:40.681923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:40.682402 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:40.682878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:40.683562 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:40.684016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:40.684440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:40.745172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:40.752727 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-71cdce0a-38c0-42ae-b2e9-1a05f07cf94e tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1382 microversion: 2.1 time: 0.081854 Aug 10 08:56:40.753644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 643/1258] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:40 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:41.774518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:41.775132 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:41.782428 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:41.782928 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:41.783504 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:41.784198 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:41.784673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:41.785095 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:41.848329 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:41.855721 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-6feb125a-846c-4d9f-9288-59d04145b51b tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1220 microversion: 2.1 time: 0.085066 Aug 10 08:56:41.856450 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 616/1259] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:41 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:42.876808 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:42.877441 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:42.883496 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:42.885520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:42.885520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:42.885520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:42.885520 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:42.886224 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:42.916830 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:42.917302 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:42.917733 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:42.918166 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lazy-loading 'fault' on Instance uuid ce07b4c5-dbd0-4cd3-9abd-9b130332a6af {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:56:42.960756 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fefe615c29f4a8290c81ec430f8d9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2788e89ec8a54cf0812124e6ce142061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:42.968223 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fee34b63-61cb-40c9-bf55-c0c81bfbb918 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 200 len: 1225 microversion: 2.1 time: 0.095348 Aug 10 08:56:42.972170 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 644/1260] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:42 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:43.990223 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:43.991124 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] [instance: ce07b4c5-dbd0-4cd3-9abd-9b130332a6af] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:43.997514 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:43.997997 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:43.998435 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:43.999144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:43.999596 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:44.000023 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:44.013838 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.wsgi [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] HTTP exception thrown: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Request method failure captured: Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: request: GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af HTTP/1.1 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept: application/json Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Accept-Encoding: identity Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Connection: close Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Length: 0 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Content-Type: application/json Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Host: 10.222.0.45 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Openstack-System-Scope: None Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: User-Agent: python-urllib3/1.26.11 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Auth-Token: gAAAAABi83FBdHFgSEGj_tD8P5v0y3ViN51p_eAV7UTen7YpZdNCLlxUhzniii1QHtsoDJemk7srht4ABuqY500j2C5FqZPZ_tVFnEba0wF1EzqRg4ePk0wtyXh8IeYoqmGHrC9mRFJ0PrZf76Pra7CYxeyzQwvysRo_yhZFkTvWewckBufOZp8 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Id: None Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Domain-Name: None Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Identity-Status: Confirmed Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Is-Admin-Project: True Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Id: default Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Domain-Name: Default Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Id: 2788e89ec8a54cf0812124e6ce142061 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Project-Name: tempest-TestShelveInstance-518843307 Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Role: reader,member Aug 10 08:56:44.015570 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Roles: reader,member Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2788e89ec8a54cf0812124e6ce142061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2788e89ec8a54cf0812124e6ce142061"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2788e89ec8a54cf0812124e6ce142061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2788e89ec8a54cf0812124e6ce142061", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant: tempest-TestShelveInstance-518843307 Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Id: 2788e89ec8a54cf0812124e6ce142061 Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-Tenant-Name: tempest-TestShelveInstance-518843307 Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User: tempest-TestShelveInstance-518843307-project Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Id: default Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Domain-Name: Default Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Id: 1fefe615c29f4a8290c81ec430f8d9ae Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: X-User-Name: tempest-TestShelveInstance-518843307-project Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: method: > Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: exception: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. Aug 10 08:56:44.018834 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: action_args: {'id': 'ce07b4c5-dbd0-4cd3-9abd-9b130332a6af'} Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:56:44.019857 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. Aug 10 08:56:44.021626 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: ERROR nova.api.openstack.wsgi Aug 10 08:56:44.023579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Returning 404 to user: Instance ce07b4c5-dbd0-4cd3-9abd-9b130332a6af could not be found. {{(pid=124809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:56:44.023579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-e56a0d2b-850e-4663-b635-ed3032307167 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af" status: 404 len: 111 microversion: 2.1 time: 0.030994 Aug 10 08:56:44.023579 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 617/1261] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:43 2022] GET /compute/v2.1/servers/ce07b4c5-dbd0-4cd3-9abd-9b130332a6af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:56:44.235029 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-c6f79366-b7a1-4f6b-86fa-fb77685d0511 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] Calling method '.version_select at 0x7fdef596ef70>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:44.318290 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-c6f79366-b7a1-4f6b-86fa-fb77685d0511 tempest-TestShelveInstance-518843307 tempest-TestShelveInstance-518843307-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1917315942" status: 202 len: 0 microversion: 2.1 time: 0.087034 Aug 10 08:56:44.318923 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 645/1262] 10.222.0.45 () {58 vars in 1254 bytes} [Wed Aug 10 08:56:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1917315942 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:56:45.779735 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:45.780253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:45.787213 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:45.787697 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:45.788675 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:45.788790 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:45.790602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:45.790602 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:45.875350 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lazy-loading 'services' on Instance uuid a2d830b0-2a2c-43d9-a872-316c51f0dd9f {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:56:46.111600 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f70d1b39-4ccc-4bcf-90bf-a9a78f0c8fbd tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f/os-volume_attachments/2cb3004c-999d-41bb-870d-188251d77717" status: 202 len: 0 microversion: 2.1 time: 0.335512 Aug 10 08:56:46.113118 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 618/1263] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:56:45 2022] DELETE /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f/os-volume_attachments/2cb3004c-999d-41bb-870d-188251d77717 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 08:56:48.323670 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:48.324206 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:48.331799 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:48.332277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:48.332707 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:48.333392 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:48.333842 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:48.334261 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:48.358975 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Going to try to terminate instance {{(pid=124810) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:56:48.574869 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a688772e-8958-46c9-9838-c69893329656 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 204 len: 0 microversion: 2.1 time: 0.254648 Aug 10 08:56:48.575604 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 646/1264] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:56:48 2022] DELETE /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 08:56:48.584688 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:48.585376 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:48.591890 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:48.596139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:48.596139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:48.596139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:48.596139 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:48.596597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:48.842677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:48.850603 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-f89f2f3c-f279-405a-8091-7021161bd8db tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1513 microversion: 2.1 time: 0.270466 Aug 10 08:56:48.851199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 619/1265] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:48 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:49.872245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:49.873034 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:49.880244 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:49.881056 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:49.881497 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:49.882217 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:49.882719 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:49.885270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:50.035109 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:50.043330 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-a045e18e-d8ae-4907-b8a4-11a2ab680dd6 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1513 microversion: 2.1 time: 0.175581 Aug 10 08:56:50.044205 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 647/1266] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:49 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:51.065534 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:51.066831 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:51.073406 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:51.074424 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:51.074882 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:51.075571 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:51.076468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:51.076949 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:51.159468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:51.176009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-56d6d5d8-4526-4c38-8a5e-5c1e7cda6b66 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1471 microversion: 2.1 time: 0.114245 Aug 10 08:56:51.189964 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 620/1267] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:51 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1471 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:51.283332 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d830b0-2a2c-43d9-a872-316c51f0dd9f", "name": "network-vif-deleted", "tag": "095fe7ae-eb77-46c5-b192-5609e3d6611e"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:56:51.294344 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:51.294965 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:51.300388 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:51.307038 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] Creating event network-vif-deleted:095fe7ae-eb77-46c5-b192-5609e3d6611e for instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f on hv-cinder-78102 Aug 10 08:56:51.328653 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-d3cff66f-7ff3-4cbf-b81d-fb2d688e230b req-a16bc89e-46ce-4710-893c-cac6d67051c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039693 Aug 10 08:56:51.331228 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 648/1268] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:56:52.197513 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:52.198134 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:52.205168 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:52.205653 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:52.206082 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:52.206988 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:52.207439 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:52.207861 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:52.247018 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:52.247505 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:52.247942 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:52.248387 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.objects.instance [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lazy-loading 'fault' on Instance uuid a2d830b0-2a2c-43d9-a872-316c51f0dd9f {{(pid=124809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:56:52.307280 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:56:52.314299 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cb22221e-4f88-4533-9453-7c2da13f0158 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 200 len: 1309 microversion: 2.1 time: 0.120723 Aug 10 08:56:52.314908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 621/1269] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:52 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:56:53.338083 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:56:53.338576 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: a2d830b0-2a2c-43d9-a872-316c51f0dd9f] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:56:53.345744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:53.346262 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:53.346727 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:53.347502 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:56:53.347961 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:56:53.348385 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:56:53.362396 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] HTTP exception thrown: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Request method failure captured: Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f HTTP/1.1 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83KLt6Tn3uYkk8PgUCfhm5f_hrDqumM3VdDRw-A-Q0WXXNn2XhkooqSOo6XFuFhKaC8ibM6bfHzVjymPaMiNe8GOy1VrDfab3OBs6B-WvcujaJZjjN_TqTsQx0LPPFVJDqjMhjRVBRdNwvag6sqVC9ld3vLrZIVPVj7nEPdO0CUqIHM Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 4df0ddc35b0b452db6b3ad901e7aa892 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:56:53.365737 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4df0ddc35b0b452db6b3ad901e7aa892", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 4df0ddc35b0b452db6b3ad901e7aa892 Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesSnapshotTestJSON-588167380-project Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: e04e4a6cd83b40698213d7a2c3714406 Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesSnapshotTestJSON-588167380-project Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. Aug 10 08:56:53.371558 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': 'a2d830b0-2a2c-43d9-a872-316c51f0dd9f'} Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:56:53.372618 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. Aug 10 08:56:53.374152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:56:53.375754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Returning 404 to user: Instance a2d830b0-2a2c-43d9-a872-316c51f0dd9f could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:56:53.375754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-114e34c8-6b66-4746-9bc8-921f8d4a5743 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f" status: 404 len: 111 microversion: 2.1 time: 0.031999 Aug 10 08:56:53.375754 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 649/1270] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:56:53 2022] GET /compute/v2.1/servers/a2d830b0-2a2c-43d9-a872-316c51f0dd9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:57:03.976251 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-568479296", "imageRef": "48c9a9b2-cad1-4700-b9aa-4533dce55694", "flavorRef": "452", "networks": [{"uuid": "a6cef1a0-ae6a-4612-b2b5-3917f55cb6ee"}]}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:57:03.984314 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:03.985007 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:04.029199 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.network.neutron [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] validate_networks() for [('a6cef1a0-ae6a-4612-b2b5-3917f55cb6ee', None, None, None, None, None)] {{(pid=124809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 08:57:04.737405 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Flavor limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 08:57:04.737824 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Image limits 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 08:57:04.738289 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Flavor pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 08:57:04.738718 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Image pref 0:0:0 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 08:57:04.739128 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.virt.hardware [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 08:57:04.747705 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:04.748178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:04.748606 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:04.749317 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:04.749761 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:04.750178 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:04.766873 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Getting quotas for project 4df0ddc35b0b452db6b3ad901e7aa892. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 08:57:04.770729 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.quota [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Getting quotas for user e04e4a6cd83b40698213d7a2c3714406 and project 4df0ddc35b0b452db6b3ad901e7aa892. Resources: {'ram', 'instances', 'cores'} {{(pid=124809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 08:57:04.781243 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Going to run 1 instances... {{(pid=124809) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 08:57:04.783468 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='48c9a9b2-cad1-4700-b9aa-4533dce55694',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 08:57:04.911367 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-a45d721f-376f-426e-abc6-fb4f3983fe1b tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939029 Aug 10 08:57:04.912000 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 622/1271] 10.222.0.45 () {60 vars in 1147 bytes} [Wed Aug 10 08:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 08:57:04.922802 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-fd024fb4-6e2f-4a7f-bc66-707096820609 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:04.924647 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-fd024fb4-6e2f-4a7f-bc66-707096820609 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:04.928374 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:04.929016 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:04.983905 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-fd024fb4-6e2f-4a7f-bc66-707096820609 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:04.992698 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-fd024fb4-6e2f-4a7f-bc66-707096820609 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1218 microversion: 2.1 time: 0.073710 Aug 10 08:57:04.993574 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 650/1272] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:04 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:06.013087 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:06.013610 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:06.020432 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:06.020916 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:06.021352 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:06.022112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:06.022595 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:06.023021 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:06.084699 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:06.092036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-385e769a-8db4-4b61-a9ab-557b86dfe931 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1222 microversion: 2.1 time: 0.083644 Aug 10 08:57:06.092588 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 623/1273] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:06 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:07.114272 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:07.114917 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:07.127134 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:07.128153 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:07.128590 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:07.129288 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:07.129744 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:07.130169 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:07.192345 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:07.200176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-04d9cdf6-b3fc-4640-b346-1dd84bb15854 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1288 microversion: 2.1 time: 0.090340 Aug 10 08:57:07.200440 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 651/1274] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:07 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:08.220637 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:08.221309 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:08.228013 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:08.228491 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:08.228922 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:08.229597 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:08.230062 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:08.230483 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:08.360605 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:08.371262 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-59e71f34-25b9-495e-9121-d5da887f89f9 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.154555 Aug 10 08:57:08.371841 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 624/1275] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:08 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:08.492551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "515247d8-ea2a-467d-a616-5b27d17fa65e", "tag": "f2758de2-2fac-482b-b6d3-f3496d576d99"}]} {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:57:08.503465 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:08.503931 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:08.504357 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:08.515786 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.compute.server_external_events [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] Creating event network-changed:f2758de2-2fac-482b-b6d3-f3496d576d99 for instance 515247d8-ea2a-467d-a616-5b27d17fa65e on hv-cinder-78102 Aug 10 08:57:08.520782 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [req-90cac332-771b-450c-a018-9600f830886a req-89d57509-e9e0-46fe-81ef-1c18bb525530 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031929 Aug 10 08:57:08.521367 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 652/1276] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 08:57:09.392682 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:09.393253 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:09.399843 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:09.400326 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:09.400757 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:09.401446 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:09.401900 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:09.402325 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:09.534603 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:09.542218 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-afd4f643-5b3a-4d4e-84fc-9080a793d25c tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.153482 Aug 10 08:57:09.542812 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 625/1277] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:09 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:10.563793 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:10.564525 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:10.570683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:10.571172 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:10.571611 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:10.572307 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:10.572766 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:10.573197 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:10.699479 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:10.707551 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-8ea2b814-e4b5-4191-8daa-c7b5dba8ce85 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.148425 Aug 10 08:57:10.708137 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 653/1278] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:10 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:11.727969 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:11.728583 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:11.735014 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:11.735495 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:11.735962 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:11.737275 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:11.737731 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:11.738156 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:11.863798 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:11.871173 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-35ad3717-d32d-45c8-af97-c393bb3fea03 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.147079 Aug 10 08:57:11.871740 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 626/1279] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:11 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:12.891659 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:12.892277 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:12.899161 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:12.899644 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:12.900079 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:12.900771 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:12.901258 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:12.901683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:13.027064 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:13.035232 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-39183c41-1ec1-46aa-acbc-c5d07a07ec1e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.147383 Aug 10 08:57:13.035791 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 654/1280] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:12 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:14.057635 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:14.058149 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:14.065000 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:14.065482 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:14.065920 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:14.066636 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:14.067088 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:14.067515 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:14.194677 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:14.202051 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-cb79b69e-40e0-49a6-9964-e9e6fee0ce12 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.148326 Aug 10 08:57:14.202644 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 627/1281] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:14 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:15.222128 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:15.222701 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:15.225229 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell0:SELECT=2 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:15.229940 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:15.230411 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:15.230874 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:15.231548 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:15.231997 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:15.232412 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:15.360893 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:15.368708 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-d0167e44-30ae-4898-b116-f60e1e48a163 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.150528 Aug 10 08:57:15.369268 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 655/1282] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:15 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:15.703364 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "515247d8-ea2a-467d-a616-5b27d17fa65e", "name": "network-vif-plugged", "status": "completed", "tag": "f2758de2-2fac-482b-b6d3-f3496d576d99"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:57:15.708419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=2 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:15.709084 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell0:SELECT=6 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:15.714667 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:15.715144 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:15.715578 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:15.726589 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] Creating event network-vif-plugged:f2758de2-2fac-482b-b6d3-f3496d576d99 for instance 515247d8-ea2a-467d-a616-5b27d17fa65e on hv-cinder-78102 Aug 10 08:57:15.731524 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-cbdf9cb8-bd56-4ad6-ae3d-e3c7659b82ac req-fb42d5e4-9356-4fc3-a6e5-c0a9f61f8dee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Aug 10 08:57:15.732101 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 628/1283] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:57:16.389935 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:16.390454 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:16.397364 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:16.397839 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:16.398270 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:16.398975 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:16.399425 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:16.399842 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:16.526725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:16.533991 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-527b45e7-c0bf-4f3e-977a-3c91f45df09a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.147965 Aug 10 08:57:16.534579 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 656/1284] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:16 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:17.556263 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:17.556910 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:17.563828 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:17.564398 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:17.564836 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:17.565525 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:17.565983 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:17.566444 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:17.698040 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:17.707090 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-51faa8db-db55-40b6-a407-2dc2cbdbe3b1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1318 microversion: 2.1 time: 0.156096 Aug 10 08:57:17.708079 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 629/1285] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:17 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:18.729216 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:18.729845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:18.736386 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:18.736859 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:18.737291 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:18.738633 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:18.739085 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:18.739505 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:18.866845 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:18.874176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-65e89c76-92b5-435a-b2df-a2c0a2fb316e tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1506 microversion: 2.1 time: 0.148817 Aug 10 08:57:18.874790 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 657/1286] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:18 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:18.894963 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f9d24d-910d-4478-807c-be8e83dde434", "device": "/dev/sdb"}} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:57:18.897908 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:18.904353 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:18.904832 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:18.905264 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:18.905955 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:18.906407 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:18.906858 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:19.621728 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-50976e56-22b6-499a-be0a-a4557dce4c4a tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "POST /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731119 Aug 10 08:57:19.622331 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 630/1287] 10.222.0.45 () {60 vars in 1323 bytes} [Wed Aug 10 08:57:18 2022] POST /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:57:41.558825 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:41.559346 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:41.561479 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_api:SELECT=18 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:41.562152 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG dbcounter [-] [124810] Writing DB stats nova_cell1:SELECT=38 {{(pid=124810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:41.566907 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:41.567390 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:41.567820 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:41.568507 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:41.568957 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:41.569531 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:41.649704 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.objects.instance [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lazy-loading 'services' on Instance uuid 515247d8-ea2a-467d-a616-5b27d17fa65e {{(pid=124810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 08:57:41.851176 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-5c629db7-f55a-4b3a-b58a-a1c1e02a80b0 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "DELETE /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e/os-volume_attachments/88f9d24d-910d-4478-807c-be8e83dde434" status: 202 len: 0 microversion: 2.1 time: 0.295997 Aug 10 08:57:41.851764 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 658/1288] 10.222.0.45 () {58 vars in 1416 bytes} [Wed Aug 10 08:57:41 2022] DELETE /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e/os-volume_attachments/88f9d24d-910d-4478-807c-be8e83dde434 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 08:57:42.966316 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:42.967129 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG dbcounter [-] [124809] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 08:57:42.971750 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:42.973179 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:42.979273 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:42.980673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:42.980673 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:42.981036 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:42.982019 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:42.982518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:43.008389 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Going to try to terminate instance {{(pid=124809) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 08:57:43.337356 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-634323bc-9388-41f6-b739-98b9a02e6c23 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "DELETE /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 204 len: 0 microversion: 2.1 time: 0.372233 Aug 10 08:57:43.337979 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 631/1289] 10.222.0.45 () {58 vars in 1239 bytes} [Wed Aug 10 08:57:42 2022] DELETE /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 08:57:43.346816 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:43.348227 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:43.355783 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:43.356256 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:43.356683 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:43.357389 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:43.357878 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:43.358297 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:43.484631 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:43.492661 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-820eb78e-3697-4321-bdc1-98fb68715ea4 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1512 microversion: 2.1 time: 0.150188 Aug 10 08:57:43.493218 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 659/1290] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:43 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:44.513537 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:44.514230 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.compute.api [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124809) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:44.520601 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:44.521075 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:44.521508 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:44.522194 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:44.522685 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:44.523110 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:44.650065 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.policy [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124809) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:44.657522 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [None req-d05b211e-daf6-425a-a9dd-4cf5b86a18d1 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1512 microversion: 2.1 time: 0.148488 Aug 10 08:57:44.658119 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 632/1291] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:44 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:45.679041 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:45.679658 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:45.686071 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:45.686589 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:45.687033 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:45.687725 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:45.688191 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:45.688617 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:45.850663 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.policy [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04e4a6cd83b40698213d7a2c3714406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df0ddc35b0b452db6b3ad901e7aa892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124810) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 08:57:45.862104 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-121c9321-760d-429a-9d74-cc1adb6d8981 tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 200 len: 1512 microversion: 2.1 time: 0.186999 Aug 10 08:57:45.863267 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 660/1292] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:45 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 08:57:45.959449 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG nova.api.openstack.wsgi [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "515247d8-ea2a-467d-a616-5b27d17fa65e", "name": "network-vif-deleted", "tag": "f2758de2-2fac-482b-b6d3-f3496d576d99"}]} {{(pid=124809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 08:57:45.970518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:45.970518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:45.970518 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: DEBUG oslo_concurrency.lockutils [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:45.981112 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.compute.server_external_events [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] Creating event network-vif-deleted:f2758de2-2fac-482b-b6d3-f3496d576d99 for instance 515247d8-ea2a-467d-a616-5b27d17fa65e on hv-cinder-78102 Aug 10 08:57:45.985809 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO nova.api.openstack.requestlog [req-2c0ccd80-00f1-4326-8ee8-003bf7a4341e req-ad46fe19-0d6c-4ea7-ae02-ce14018c9461 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030430 Aug 10 08:57:45.986419 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: [pid: 124809|app: 0|req: 633/1293] 10.222.0.45 () {64 vars in 1317 bytes} [Wed Aug 10 08:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 08:57:46.884681 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Calling method '>' {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 08:57:46.885245 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.compute.api [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] [instance: 515247d8-ea2a-467d-a616-5b27d17fa65e] Fetching instance by UUID {{(pid=124810) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 08:57:46.891635 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:46.892115 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:46.892550 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:46.893236 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Acquiring lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 08:57:46.893688 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 08:57:46.894157 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG oslo_concurrency.lockutils [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Lock "9b14cff7-dd7a-4ce6-bf18-ff6ec854a829" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 08:57:46.907296 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.wsgi [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] HTTP exception thrown: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Request method failure captured: Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: request: GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e HTTP/1.1 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept: application/json Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Accept-Encoding: identity Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Connection: close Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Length: 0 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Content-Type: application/json Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Host: 10.222.0.45 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Openstack-System-Scope: None Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: User-Agent: python-urllib3/1.26.11 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Auth-Token: gAAAAABi83KLt6Tn3uYkk8PgUCfhm5f_hrDqumM3VdDRw-A-Q0WXXNn2XhkooqSOo6XFuFhKaC8ibM6bfHzVjymPaMiNe8GOy1VrDfab3OBs6B-WvcujaJZjjN_TqTsQx0LPPFVJDqjMhjRVBRdNwvag6sqVC9ld3vLrZIVPVj7nEPdO0CUqIHM Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Id: None Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Domain-Name: None Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Identity-Status: Confirmed Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Is-Admin-Project: True Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Id: default Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Domain-Name: Default Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Id: 4df0ddc35b0b452db6b3ad901e7aa892 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Role: reader,member Aug 10 08:57:46.908908 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Roles: reader,member Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4df0ddc35b0b452db6b3ad901e7aa892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4df0ddc35b0b452db6b3ad901e7aa892", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}] Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Id: 4df0ddc35b0b452db6b3ad901e7aa892 Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-588167380 Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User: tempest-VolumesSnapshotTestJSON-588167380-project Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Id: default Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Domain-Name: Default Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Id: e04e4a6cd83b40698213d7a2c3714406 Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: X-User-Name: tempest-VolumesSnapshotTestJSON-588167380-project Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: method: > Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: exception: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. Aug 10 08:57:46.911287 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: action_args: {'id': '515247d8-ea2a-467d-a616-5b27d17fa65e'} Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: {{(pid=124810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 08:57:46.912410 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. Aug 10 08:57:46.914117 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: ERROR nova.api.openstack.wsgi Aug 10 08:57:46.915646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: DEBUG nova.api.openstack.wsgi [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] Returning 404 to user: Instance 515247d8-ea2a-467d-a616-5b27d17fa65e could not be found. {{(pid=124810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 08:57:46.915646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO nova.api.openstack.requestlog [None req-ea67a177-212c-4055-9062-75365d366fee tempest-VolumesSnapshotTestJSON-588167380 tempest-VolumesSnapshotTestJSON-588167380-project] 10.222.0.45 "GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e" status: 404 len: 111 microversion: 2.1 time: 0.030448 Aug 10 08:57:46.915646 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: [pid: 124810|app: 0|req: 661/1294] 10.222.0.45 () {58 vars in 1236 bytes} [Wed Aug 10 08:57:46 2022] GET /compute/v2.1/servers/515247d8-ea2a-467d-a616-5b27d17fa65e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 08:58:22.238009 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:58:22.238548 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 08:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 08:59:44.178759 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 08:59:44.179336 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Wed Aug 10 08:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:00:15.224390 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:00:15.224978 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 09:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:00:15.849195 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:00:15.849416 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 09:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:00:47.135985 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:00:47.136553 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Wed Aug 10 09:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:01:39.749743 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:01:39.750510 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Wed Aug 10 09:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:01:42.245993 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:01:42.246441 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 09:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:03:04.187325 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:03:04.187875 dv-cinder-781024-3-iscsi devstack@n-api.service[124810]: Wed Aug 10 09:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:03:35.232698 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:03:35.233246 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 09:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 09:03:35.858427 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 09:03:35.858672 dv-cinder-781024-3-iscsi devstack@n-api.service[124809]: Wed Aug 10 09:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!